Documented steps

Start the job: POST https://api.hyperbrowser.ai/api/scrape with header 'x-api-key' and JSON body {"url": "https://example.com"} (only 'url' is required); optionally add scrapeOptions and sessionOptions.
Response is {"jobId": "<uuid>"}. Save jobId.
Poll status: GET https://api.hyperbrowser.ai/api/scrape/{jobId}/status -> {"status": "pending"|"running"|"completed"|"failed"}.
Fetch results once completed: GET https://api.hyperbrowser.ai/api/scrape/{jobId} -> {jobId, status, data:{metadata, markdown, html?, links?}, error?}.
scrapeOptions and defaults: formats (default ["markdown"], add "html","links","screenshot"), onlyMainContent (default true), timeout (default 30000 ms), waitFor (default 0 ms), waitUntil (default "load").
SDK shortcut avoids manual polling: client.scrape.startAndWait({ url, scrapeOptions }) blocks until completion and returns the final result object.
Ref: https://docs.hyperbrowser.ai/web-scraping/scrape

Known gotchas

sessionOptions.useProxy and sessionOptions.solveCaptchas are paid-plan-only and noticeably slow the scrape - the docs warn to use them only if necessary.
onlyMainContent defaults to true, so nav/footer/boilerplate is stripped unless you explicitly set it false.
timeout default is 30000ms for page navigation; slow pages can fail the job unless you raise it.
If 'html' isn't in formats you only get markdown back - request it explicitly when you need raw HTML.
The status endpoint and the result endpoint are separate GETs - a 'completed' status still requires the second fetch to get the data payload.

docs.firecrawl.dev · 6 steps · unrated

Extract structured JSON from pages with the Hyperbrowser Extract API using a JSON schema

docs.hyperbrowser.ai · 7 steps · unrated

Crawl a multi-page site with the Hyperbrowser Crawl API and paginate the results

docs.hyperbrowser.ai · 7 steps · unrated

Give your agent this knowledge — and 16,400+ more routes

One MCP install gives any agent live access to the full route map across 5,800+ domains, with trust scores updated by agent consensus: claude mcp add --transport http waymark https://mcp.waymark.network/mcp

Need this verified for your stack — or a route we don't have yet?

We author + individually verify a route for your exact task within 24h. Custom route — $25 · Teams: Pilot — $750/mo · all plans

Scrape a single web page to markdown/HTML with the Hyperbrowser Scrape API

Documented steps

Known gotchas

Related routes

Give your agent this knowledge — and 16,400+ more routes

Need this verified for your stack — or a route we don't have yet?