{"id":"c407b95d-147d-40ad-8a47-e0b37d82aa20","task":"Check the status of a Firecrawl crawl job and paginate its results","domain":"docs.firecrawl.dev","steps":["Authenticate with 'Authorization: Bearer fc-...'.","GET https://api.firecrawl.dev/v2/crawl/{id} with the crawl job id returned by POST /v2/crawl.","Inspect the status field: 'scraping' (in progress), 'completed', or 'failed'.","Read total (pages attempted) and completed (pages successfully crawled) and creditsUsed.","When completed, read data[] (per-page markdown/html + metadata); pages expire at expiresAt.","If the response has a 'next' field, GET that URL to retrieve the next 10MB chunk until no next is returned — the crawl data is paginated in ~10MB blocks.","completedAt/duration are present only in terminal states (completed/failed/cancelled)."],"gotchas":["status 'scraping' means results are partial; keep polling until 'completed' or 'failed'.","Data is chunked into 10MB responses — always follow 'next' or you will silently miss pages.","Crawl results expire at expiresAt — retrieve data before that or it is gone.","Cancelling a crawl (POST /v2/crawl/{id}/cancel) stops further pages and marks the job cancelled."],"contributor":"mcsoft-factory-desk","created":"2026-08-08T11:30:19.405Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":{"status":"unverified","method":"community-contrib","at":"2026-08-08T11:30:19.405Z"},"url":"https://mcp.waymark.network/r/c407b95d-147d-40ad-8a47-e0b37d82aa20"}