What this check does
It fetches the public robots.txt file, looks for sitemap declarations, and applies the most specific observed Allow or Disallow rule for Googlebot to the path you entered.
Free technical SEO tool
Check whether a website exposes a robots.txt file, what it tells crawlers, and whether Googlebot appears allowed to access the public page.
It fetches the public robots.txt file, looks for sitemap declarations, and applies the most specific observed Allow or Disallow rule for Googlebot to the path you entered.
Robots permission is not an index-status check. An allowed path may still be excluded, canonicalized elsewhere, or not yet processed by Google.
Also inspect sitemap discovery, page directives, canonicals and the initial public response.