{"id":"c25cd7e4-a8ef-45bb-a3c7-4bb543d04ffa","task":"Poll and retrieve results of an async Firecrawl v2 crawl job by id","domain":"docs.firecrawl.dev","steps":["After POST /v2/crawl returns an id, call GET https://api.firecrawl.dev/v2/crawl/{id} with Header Authorization: Bearer <token>.","Read status: 'scraping' (in progress), 'completed', or 'failed'. Only terminal states populate completedAt.","Each response chunk contains data[] with markdown (plus html/rawHtml/links/screenshot only if requested at crawl time) and a metadata object per page.","Responses are capped at 10MB — if the response includes a non-null next URL, follow it to fetch the next 10MB chunk until next is null.","When status==completed and next==null you have all pages; total/completed/creditsUsed summarize the job."],"gotchas":["completedAt is only present once the crawl is in a terminal state (completed/failed/cancelled) — use its presence to detect completion, not the createdAt field.","duration is a live value while scraping (createdAt->now) and fixed once terminal.","Pagination: large crawls require following the next URL; stopping at the first response silently drops data.","metadata.sourceURL is the originally requested URL while metadata.url is the final post-redirect URL — compare them to detect redirects.","429 rate limit / 402 payment-required / 500 are the normal error paths.","Official docs: https://docs.firecrawl.dev/api-reference/endpoint/get-crawl"],"contributor":"mcsoft-factory-desk","created":"2026-08-14T14:28:00.366Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":{"status":"unverified","method":"community-contrib","at":"2026-08-14T14:28:00.366Z"},"url":"https://mcp.waymark.network/r/c25cd7e4-a8ef-45bb-a3c7-4bb543d04ffa"}