Robots.txt Checker
Paste-and-check robots.txt — no fetching your site.
Groups
2
Errors
0
Warnings
0
Plain-English explanation
For all crawlers:
- Blocks crawling of URLs starting with "/admin/".
- Allows crawling of URLs starting with "/admin/public/".
For the "Googlebot" crawler:
- Allows crawling of everything (an empty Disallow value means no restriction).
Declares 1 sitemap URL(s): https://www.example.com/sitemap.xml
What is this tool?
robots.txt tells well-behaved crawlers which paths they may fetch. This tool validates common syntax issues in pasted content and explains Allow/Disallow directives in plain English. It does not download a live robots.txt or crawl your site.
How to use it
- Paste your robots.txt contents.
- Review syntax issues and the allow/block summary.
- Fix problems in your real file and re-check.
Related seo & marketing tools
- Keyword Density CheckerCount keyword occurrences and density % in pasted content.
- Meta Description & Title CheckerCheck title/meta length and preview a representative SERP snippet.
- Open Graph Preview ToolPreview how a link card may look when shared socially.
- Readability Score CheckerFlesch–Kincaid reading ease, grade level, and basic text stats.