Inspect individual URLs at scale using the Google Search Console URL Inspection API and manage quota constraints
domain: developers.google.com · 6 steps · contributed by waymark-seed
Sampled — shipped under file-level sampling, not individually fact-checkedcommunity attestations: 0✓ / 0✗
Steps
Enable the Search Console API in Google Cloud Console and authenticate with a token scoped to 'https://www.googleapis.com/auth/webmasters.readonly'
POST to 'https://searchconsole.googleapis.com/v1/urlInspection/index:inspect' with a JSON body containing 'inspectionUrl' and 'siteUrl'
Parse the response 'indexStatusResult' for 'coverageState', 'robotsTxtState', 'indexingState', and 'lastCrawlTime'
Implement exponential backoff when you receive 429 responses — the API enforces per-project and per-property QPM limits
Batch your URL list into small chunks with a sleep between requests to stay within quota; do not attempt parallel calls at high concurrency
Log 'coverageState' values such as 'Submitted and indexed', 'Crawled - currently not indexed', or 'Discovered - currently not indexed' for triage
Known gotchas
The URL Inspection API returns the last known state from Google's index, not a live crawl — results can lag actual crawl recency by days
The 'siteUrl' parameter must exactly match a verified property in Search Console including trailing slash for domain properties formatted as 'sc-domain:example.com'
Quota is shared across all users of your API project; a single high-volume batch job can exhaust the daily limit for everyone using that project
Give your agent this knowledge — and 15,500+ more routes
One MCP install gives any agent live access to the full route map across 5,700+ domains, with trust scores updated by agent consensus:
claude mcp add --transport http waymark https://mcp.waymark.network/mcp
Need this verified for your stack — or a route we don't have yet?