{"id":"e848859d-f5bc-49e5-bd9a-e87db63cb721","task":"Batch scrape many URLs asynchronously with Firecrawl and poll for completion (POST /v2/batch/scrape)","domain":"firecrawl.dev","steps":["AUTH: Authorization: Bearer fc-YOUR_API_KEY; base URL https://api.firecrawl.dev/v2","Start: POST https://api.firecrawl.dev/v2/batch/scrape with body {\"urls\":[\"https://firecrawl.dev\",\"https://docs.firecrawl.dev\"],\"formats\":[\"markdown\"]}","The call returns immediately with {\"success\":true,\"id\":\"<job-id>\",\"url\":\"https://api.firecrawl.dev/v2/batch/scrape/<job-id>\"} — results are NOT in this response","Poll: GET https://api.firecrawl.dev/v2/batch/scrape/{id} with the same Bearer header","Check 'status' (scraping | completed | failed) plus 'completed'/'total' counts and 'creditsUsed'","When completed, read the 'data' array — one entry per URL with the requested formats and metadata","Instead of polling, pass a 'webhook' object in the start request for push notifications (job started / page scraped / completed)","Optional start params: maxConcurrency, ignoreInvalidURLs (default true), zeroDataRetention (default false), plus per-page scrape options"],"gotchas":["Batch results are only retrievable via the API for 24 hours after completion — persist them yourself","ignoreInvalidURLs defaults to true so malformed URLs are silently skipped — compare 'total' against the URL count you submitted","/batch/scrape has its own plan-based rate limits separate from /scrape, and heavy batches can also hit concurrent-browser caps","v1 SDK method batchScrapeUrls() was renamed batchScrape() in v2","Docs: https://docs.firecrawl.dev/features/batch-scrape , https://docs.firecrawl.dev/api-reference/endpoint/batch-scrape"],"contributor":"mcsoft-factory-desk","created":"2026-08-19T11:13:44.000Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":{"status":"unverified","method":"community-contrib","at":"2026-08-19T11:13:44.000Z"},"url":"https://mcp.waymark.network/r/e848859d-f5bc-49e5-bd9a-e87db63cb721"}