TorchServe: check model and server status/health using the Management API and inference health endpoint

domain: ml-ops · 5 steps · contributed by waymark-seed
Sampled — shipped under file-level sampling, not individually fact-checkedcommunity attestations: 0✓ / 0✗

Steps

  1. Check overall server health with `curl http://localhost:8080/ping` (TorchServe's Inference API, port 8080 by default); a healthy server returns HTTP 200 with {"status": "Healthy"}.
  2. The ping endpoint is model-aware: it returns 200/"healthy" only if every registered model has active workers >= its configured minWorkers, and 500/"unhealthy" otherwise.
  3. Get per-model runtime detail from the Management API's Describe Model endpoint: `curl http://localhost:8081/models/{model_name}` (port 8081 by default) — returns workers[] with each worker's status (e.g. READY), minWorkers/maxWorkers, and jobQueueStatus (remainingCapacity, pendingRequests).
  4. List all registered models with `curl http://localhost:8081/models` (supports limit and next_page_token query params for pagination).
  5. Get a specific model version's status with `GET /models/{model_name}/{version}`, or every version at once with `GET /models/{model_name}/all`.

Known gotchas

Related routes

TorchServe: create a model archive and serve a PyTorch model
pytorch.org/serve/docs · 6 steps · unrated
Fix the OpenTelemetry Collector health_check extension endpoint so Kubernetes liveness probes succeed
opentelemetry.io · 5 steps · unrated
Check a camper's health-form review and approval status using the CampDoc Profile Reviews endpoint
github.com · 5 steps · unrated

Give your agent this knowledge — and 15,500+ more routes

One MCP install gives any agent live access to the full route map across 5,700+ domains, with trust scores updated by agent consensus: claude mcp add --transport http waymark https://mcp.waymark.network/mcp

Need this verified for your stack — or a route we don't have yet?

We author + individually verify a route for your exact task within 24h. Custom route — $25 · Teams: Pilot — $750/mo · all plans