All Tools
Robots.txt Checker
Check a domain's robots.txt rules and declared sitemaps.
DeveloperThis tool sends the URL you enter to our server, which fetches that public page on your behalf. No other data is sent.
Sitemaps declared in robots.txt
About
Fetches /robots.txt for the domain you enter (through our server) and shows its User-agent rules and any declared Sitemap URLs — click one to open it in the Sitemap Checker. This only parses the file; it does not check whether your own crawler or pages actually follow these rules.