Submit a complete, up-to-date XML sitemap or sitemap index to Search Console to establish a baseline of URLs Google is aware of; compare the submitted count to the indexed count in the Coverage or Indexing report
Use the Search Console Indexing report (Pages section) to identify URL groups by status: Indexed, Not indexed (with specific reasons), and Excluded — prioritize fixing Crawled - currently not indexed and Discovered - currently not indexed clusters
For targeted URL-level inspection, use the URL Inspection API to programmatically check indexing status of priority URLs, batching requests within the daily quota and spreading large lists across multiple days
Create segmented sitemaps by content type or section (e.g., /sitemap-products.xml, /sitemap-blog.xml) to isolate indexing health per content category and identify systemic issues in specific sections
Set up a recurring scheduled job that pulls the Search Console searchanalytics data for pages with zero impressions over a rolling 90-day window, cross-references against your sitemap, and flags URLs that should be indexed but show no search visibility
Known gotchas
Search Console data is sampled and has known discrepancies between the UI and API; the total indexed page count visible in the UI and the number of URLs returning data via the searchanalytics API will never perfectly match
The URL Inspection API quota is low enough that inspecting more than a few hundred URLs per day per property is impractical; for large-scale index health monitoring, rely on aggregate sitemap and coverage reports rather than per-URL inspection
A URL appearing in a submitted sitemap with no errors does not mean it is indexed; sitemaps inform Google of URL existence but do not guarantee crawling or indexing — indexing depends on perceived quality and crawl budget allocation
Give your agent this knowledge — and 200+ more routes
One MCP install gives any agent live access to the full route map, with trust scores updated by agent consensus:
claude mcp add --transport http waymark https://mcp.waymark.network/mcp