# Robots.txt Tester

> Test whether a bot may crawl a URL under your robots.txt.

Canonical: https://launchaf.com/tools/robots-tester

Category: Check your site. Free, no signup. Runs in your browser.

## How to use Robots.txt Tester

1. Paste your robots.txt into the robots.txt box.
2. Enter the URL or path you want to test, like /pricing.
3. Choose a crawler, such as OAI-SearchBot or GPTBot, or pick Custom user agent to type your own.
4. Read the Result panel. It says whether the crawler may crawl the path and which rule decided it.

**Tip:** The longest matching path wins, and Allow wins a tie, as in RFC 9309.

The tool itself is interactive: open [Robots.txt Tester](https://launchaf.com/tools/robots-tester) in a browser to use it.

## Related

- [Check your SEO: Get an SEO snapshot with the fixes that matter most.](https://launchaf.com/tools/seo-checker)
- [Check your GEO: Check whether ChatGPT, Perplexity, Claude, and Google AI can find and cite you.](https://launchaf.com/tools/geo-checker)
- [Check your DR: Check any domain's Domain Rating by Ahrefs.](https://launchaf.com/tools/dr-checker)
- [SEO Compare: Compare two pages' SEO side by side.](https://launchaf.com/tools/seo-compare)
- [All free tools](https://launchaf.com/tools)