Free robots.txt checker
See whether Google and AI answer bots can read your site, and whether your sitemap is listed.
Free. No signup. Takes about 10 seconds.
Questions
- What is robots.txt?
- A plain text file at the root of your site that tells crawlers which sections they may visit. Well-behaved bots follow it. It is not a security control.
- Should I block AI bots?
- Blocking answer bots can keep assistants from reading your pages. Blocking training bots is a business choice. Our guide explains the difference.
- Does having no robots.txt hurt me?
- No. Crawlers will visit everything. A file is useful when you want to list your sitemap or keep bots out of certain sections.