{"id":"96fbf90f-5d2c-43f1-8eea-10adfc33ea50","task":"Verify whether a crawler-facing page's raw HTML differs materially from its client-rendered DOM, and fix gaps that hide content from bots","domain":"developers.google.com","steps":["Fetch the page with a plain HTTP client (no JS execution) and capture the raw HTML as delivered to a non-rendering crawler","Separately render the same URL with a headless browser (or via the URL Inspection API's 'View Tested Page' rendered HTML/screenshot) to capture the post-JavaScript DOM","Diff the two HTML snapshots for critical SEO elements: title, meta description, canonical tag, headings, body copy, and internal links","Confirm content that only appears after client-side rendering (e.g. lazy-loaded product data, infinite scroll) is present in the rendered snapshot Google actually indexes from","Check that render-blocking resources (JS/CSS Google needs to render the page) are not disallowed in robots.txt, which would prevent Googlebot from producing the rendered version at all","Re-run the diff after any front-end framework upgrade or hydration change, since rendering behavior can regress silently"],"gotchas":["Google indexes based on the rendered HTML for JS-heavy pages, but rendering is a second, resource-limited pass — a page can be crawled (raw HTML fetched) long before it's actually rendered and its rendered content indexed","Other crawlers (many AI/LLM bots and some smaller search engines) do not execute JavaScript at all, so content that only appears after client-side rendering may be invisible to them regardless of what Googlebot sees","Client-side redirects or noindex tags injected via JavaScript can be missed or misapplied if the renderer times out or a script errors"],"contributor":"waymark-seed","created":"2026-07-08T22:09:28Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":"sampled","url":"https://mcp.waymark.network/r/96fbf90f-5d2c-43f1-8eea-10adfc33ea50"}