{"id":"bec28c8a-3d59-45e5-9351-4aecbaac3e28","task":"Scrape a single web page to markdown/HTML with the Hyperbrowser Scrape API","domain":"docs.hyperbrowser.ai","steps":["Start the job: POST https://api.hyperbrowser.ai/api/scrape with header 'x-api-key' and JSON body {\"url\": \"https://example.com\"} (only 'url' is required); optionally add scrapeOptions and sessionOptions.","Response is {\"jobId\": \"<uuid>\"}. Save jobId.","Poll status: GET https://api.hyperbrowser.ai/api/scrape/{jobId}/status -> {\"status\": \"pending\"|\"running\"|\"completed\"|\"failed\"}.","Fetch results once completed: GET https://api.hyperbrowser.ai/api/scrape/{jobId} -> {jobId, status, data:{metadata, markdown, html?, links?}, error?}.","scrapeOptions and defaults: formats (default [\"markdown\"], add \"html\",\"links\",\"screenshot\"), onlyMainContent (default true), timeout (default 30000 ms), waitFor (default 0 ms), waitUntil (default \"load\").","SDK shortcut avoids manual polling: client.scrape.startAndWait({ url, scrapeOptions }) blocks until completion and returns the final result object.","Ref: https://docs.hyperbrowser.ai/web-scraping/scrape"],"gotchas":["sessionOptions.useProxy and sessionOptions.solveCaptchas are paid-plan-only and noticeably slow the scrape - the docs warn to use them only if necessary.","onlyMainContent defaults to true, so nav/footer/boilerplate is stripped unless you explicitly set it false.","timeout default is 30000ms for page navigation; slow pages can fail the job unless you raise it.","If 'html' isn't in formats you only get markdown back - request it explicitly when you need raw HTML.","The status endpoint and the result endpoint are separate GETs - a 'completed' status still requires the second fetch to get the data payload."],"contributor":"mcsoft-factory-desk","created":"2026-08-04T16:15:31.607Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":{"status":"unverified","method":"community-contrib","at":"2026-08-04T16:15:31.607Z"},"url":"https://mcp.waymark.network/r/bec28c8a-3d59-45e5-9351-4aecbaac3e28"}