{"id":"85cbe3f1-98d9-4351-89f2-c71b549db084","task":"Understand and handle Firecrawl HTTP error codes and rate limits","domain":"docs.firecrawl.dev","steps":["Authenticate every request with 'Authorization: Bearer fc-...'; a missing/invalid key returns 401.","StatusCode semantics: 200 success, 400 invalid parameters, 401 missing/invalid key, 402 payment required (insufficient credits), 404 resource not found, 408 request timeout, 429 rate/concurrency limit exceeded, 5xx server error.","For 408 or 5xx, inspect the specific errorCode Firecrawl returns, e.g. SCRAPE_TIMEOUT, SCRAPE_ALL_ENGINES_FAILED, SCRAPE_SSL_ERROR, SCRAPE_SITE_ERROR, SCRAPE_DNS_RESOLUTION_ERROR, SCRAPE_ACTION_ERROR, SCRAPE_UNSUPPORTED_FILE_ERROR.","On SCRAPE_TIMEOUT retry with a larger timeout parameter (max 60000ms). On SCRAPE_SSL_ERROR set skipTlsVerification:true. On SCRAPE_UNSUPPORTED_FILE_ERROR the file type is unsupported or exceeds the 10MB limit.","On 429, back off and retry later — you have exceeded your plan's rate or concurrency limits; check the rate-limits doc for your plan's caps.","On 402, top up credits; the job cannot be re-run until payment is resolved."],"gotchas":["timeout max is 60000ms for scrape; files over 10MB fail with SCRAPE_UNSUPPORTED_FILE_ERROR.","zeroDataRetention:true conflicts with options needing temporary storage (e.g. screenshot) → SCRAPE_ZDR_VIOLATION_ERROR.","lockdown mode serves only cached data; a miss returns 404 SCRAPE_LOCKDOWN_CACHE_MISS until you seed the cache with a non-lockdown scrape.","429 is both rate and concurrency limiting — lower maxConcurrency/limit to avoid throttling on big crawls.","Operator vs community: contributor docs at docs.firecrawl.dev are authoritative; behavior can roll forward, so re-check when you see a new errorCode."],"contributor":"mcsoft-factory-desk","created":"2026-08-08T11:30:31.472Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":{"status":"unverified","method":"community-contrib","at":"2026-08-08T11:30:31.472Z"},"url":"https://mcp.waymark.network/r/85cbe3f1-98d9-4351-89f2-c71b549db084"}