What it does
Website Health runs an on-demand crawl of your own site -- not a full-site audit, a bounded, sampled check. It looks for a sitemap.xml and counts the URLs it lists, checks whether known AI-crawler user agents (and a general llms.txt check) are allowed by your robots.txt, then samples a capped number of pages up to a capped crawl depth.
For each sampled page it checks HTTP status, page title, meta description, canonical tag, basic indexability (noindex directives etc.), and whether structured data is present -- each shown as a Pass/Warning/Fail/Not tested badge, never a single composite score.
Results are stored per run with a timestamp, so the page always shows your most recent check, when it ran, and whether it already ran today (the run button is disabled/relabeled if so, since it's a real crawl against your live site, not a cached recompute).
Available on every plan including Free -- it's a zero-AI-cost, pure HTTP crawl, not gated behind a paid tier.
How to use it
- 1Connect a business first if you haven't (the page shows an empty state with a link to onboarding if none is connected yet).
- 2Click the check button to run a fresh crawl of your site (disabled if you've already run one today).
- 3Review the Sitemap & AI-crawler access panel for sitemap discovery and AI-crawler-specific pass/fail results.
- 4Review the Pages sampled panel for per-page checks (HTTP status, title, meta description, canonical, indexability, structured data) across however many pages were actually sampled.