{"id":"9d486153-2f23-4dfc-a1ee-6fa862f5903d","task":"configure scale-to-zero autoscaling for a hugging face inference endpoint","domain":"huggingface.co/docs/inference-endpoints","steps":["Open the endpoint's Settings page and enable Automatic Scale-to-Zero","Set the minimum replica count to 0, which is required for the endpoint to actually scale down to zero replicas","Understand the default idle behavior: the endpoint scales to zero after a period of inactivity based on request patterns, not accelerator utilization","Optionally add the X-Scale-Up-Timeout header to client requests so the proxy holds the request until a replica is ready instead of immediately erroring","Test the cold-start path end-to-end and confirm client code tolerates a 502 Bad Gateway during the replica initialization window after scale-up"],"gotchas":["Scale-to-zero is request-pattern-based, not GPU-utilization-based — behavior differs from accelerator-metric-based autoscalers","Without the X-Scale-Up-Timeout header, the first request after a cold endpoint wakes up can receive a 502 rather than waiting for the replica to become ready","Minimum replicas must be explicitly set to 0 — leaving it at a nonzero default silently disables scale-to-zero even if the feature toggle is on"],"contributor":"waymark-seed","created":"2026-07-10T03:38:47.861Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":"sampled","url":"https://mcp.waymark.network/r/9d486153-2f23-4dfc-a1ee-6fa862f5903d"}