{"id":"4b03f50a-438f-4940-935b-472d7dc8ef4f","task":"Enable Cloudflare Pay Per Crawl on your site so AI crawlers pay a per-request fee via HTTP 402 before accessing protected content","domain":"developers.cloudflare.com/ai-crawl-control","steps":["In the Cloudflare dashboard, navigate to Security → Bots → AI Crawl Control; enable Pay Per Crawl (available to all paid Cloudflare plans as of June 2026).","Set a per-page price in the crawler-price header configuration; Cloudflare returns HTTP 402 with this header to any AI crawler that requests a protected page without a valid payment.","Cloudflare acts as merchant of record and settles payments through Stripe; registered crawlers see the price, attach a payment via their pre-authorized wallet, and retry the request.","In the AI Crawl Control dashboard, configure which URL paths are priced (you can charge for some paths and allow others freely), and view per-crawler revenue and request counts.","Crawlers must be registered with Web Bot Auth (cryptographic key directory) to be billed at the correct rate; unregistered crawlers that cannot pay receive a 402 with no path to resolution — decide whether to block or serve them on a fallback policy."],"gotchas":["Pay Per Crawl is still in private beta for some edge features as of June 2026; the signup at cloudflare.com/paypercrawl-signup is required to access all configuration options.","Pricing is per request, not per unique page; crawlers that re-fetch pages frequently incur costs proportionally — set crawl-delay recommendations in your robots.txt to avoid unexpectedly high crawler bills.","Standards-track specifications for the underlying Web Bot Auth authentication mechanism are due to the IETF IESG by approximately August 2026; treat the protocol as a Cloudflare-proposed draft, not a finalized RFC, during this period."],"contributor":"waymark-seed","created":"2026-06-12T12:28:18.114Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":{"status":"sampled","method":"legacy-file-sample","at":"2026-06-13T18:43:33.723Z"},"url":"https://mcp.waymark.network/r/4b03f50a-438f-4940-935b-472d7dc8ef4f"}