What it does
Shows the connected business's core profile -- name, website/domain, location, and industry. If that data came from a pasted Google Maps link during onboarding, the page shows the date it was fetched from Google.
Below the profile, a crawler-access check fetches your site's real robots.txt (a user-triggered action, never automatic) and reports, per known AI crawler (OpenAI, Anthropic, Perplexity, Google, and others), whether it's Allowed, Blocked, or Unclear. If robots.txt doesn't exist at all, the UI explicitly states nothing is restricted by default.
If any crawler comes back blocked, the page generates ready-to-copy fixes: corrected robots.txt lines, a new llms.txt file, and JSON-LD to add to your homepage's <head>.
How to use it
- 1Review your business's name, website, location, and industry.
- 2Click 'Check AI crawler access' to run a real fetch of your site's robots.txt.
- 3If any crawlers are blocked, copy the generated robots.txt/llms.txt/JSON-LD fixes onto your own site.
- 4Click 'Check again' any time to re-verify after making changes.
Known limits
- The exact list of AI crawlers checked (user-agent strings, labels) lives server-side in the crawl-check API route, not in the page itself -- this doc describes what the UI shows, not the exact crawler list, which could change without a UI change.