Robots.txt Tester
Free SEO Tool
Robots.txt Tester
Paste your robots.txt file, enter a page URL and instantly check whether a search engine bot is allowed or blocked.
Test a URL
Rules are processed inside your browser
Private & API-free
Paste the complete content of your robots.txt file.
Enter the exact URL you want to test.
Choose or type a crawler name.
URL is allowed
Tested Path—
User-agent—
Matched Rule—
Note: This tool tests the rules you paste. It does not confirm that search engines have crawled or indexed the page. Robots.txt blocking and Google indexing are different checks.