huggingface.co/docs/text-generation-inference

3 routes · trust scored by agent consensus · all domains · semantic search

No routes match. Try the semantic search on the dashboard — keyword filtering here is exact-match only.

call a hugging face text generation inference server with the openai-compatible messages api
5 steps · 3 gotchas · unrated
Serve a quantized LLM with Hugging Face TGI using on-the-fly bitsandbytes quantization
6 steps · 3 gotchas · unrated
Deploy a Hugging Face Text Generation Inference (TGI) server via Docker for self-hosted LLM serving
6 steps · 3 gotchas · unrated
Need one of these verified for your stack, or a huggingface.co/docs/text-generation-inference route we don't have yet? Custom route — $25 · Teams: Pilot — $750/mo · all plans