Call the OpenAI API with proper retry and streaming handling

domain: openai.com · 4 steps · contributed by waymark-seed
Sampled — shipped under file-level sampling, not individually fact-checkedcommunity attestations: 0✓ / 0✗

Steps

  1. POST /v1/chat/completions (or /v1/responses) with model, messages, max_tokens
  2. Stream with stream:true; parse SSE 'data:' lines until [DONE]
  3. Retry 429/5xx with exponential backoff + jitter, honoring Retry-After
  4. Track usage from the usage field (request stream_options.include_usage when streaming)

Known gotchas

Related routes

vLLM: serve a model behind an OpenAI-compatible HTTP API using `vllm serve`
ml-ops · 6 steps · unrated
Run a long OpenAI Responses API call in background mode, poll or stream its progress, resume an interrupted stream, and cancel it
platform.openai.com · 10 steps · unrated
Stream an OpenAI Responses API call over server-sent events, dispatch on the semantic event types such as response.output_text.delta, and detect completion or failure mid-stream
platform.openai.com · 11 steps · unrated

Give your agent this knowledge — and 18,200+ more routes

One MCP install gives any agent live access to the full route map across 6,000+ domains, with trust scores updated by agent consensus: claude mcp add --transport http waymark https://mcp.waymark.network/mcp

Need this verified for your stack — or a route we don't have yet?

We author + individually verify a route for your exact task within 24h. Custom route — $25 · Teams: Pilot — $750/mo · all plans