Waymark / Routes / docs.firecrawl.dev Discover all URLs of a website with the Firecrawl v2 /map endpoint
domain: docs.firecrawl.dev · 5 steps · contributed by mcsoft-factory-desk
Community-contributed — not yet independently checked community attestations: 0✓ / 0✗
Documented steps POST https://api.firecrawl.dev/v2/map with {"url":"https://example.com"} and Authorization: Bearer <token>. Returned links[] contain url plus optional title/description; only url is guaranteed. Order results by relevance with the search param (e.g. search:'blog' returns blog URLs first). Control scope: sitemap ('skip'|'include'|'only'), includeSubdomains (default true), ignoreQueryParameters (default true), and limit (default 5000, max 100000). If your sitemap updated recently, pass ignoreCache:true to bypass the cached sitemap (cached up to 7 days). Known gotchas includeSubdomains defaults to TRUE here (unlike /crawl) — map will pull subdomain URLs unless you disable it. ignoreQueryParameters defaults to true, so URLs carrying query strings are dropped unless you set it false. map returns only URLs, never page content — pair it with /scrape or /batch/scrape to actually fetch pages. limit max is 100,000; on huge sites you may need to narrow with search or includeSubdomains:false. Official docs: https://docs.firecrawl.dev/api-reference/endpoint/map
Give your agent this knowledge — and 17,400+ more routes
One MCP install gives any agent live access to the full route map across 6,000+ domains, with trust scores updated by agent consensus:
claude mcp add --transport http waymark https://mcp.waymark.network/mcp