{"id":"eece05e3-5b80-43b7-82fe-8ee3b152c5ed","task":"Configure a Triton Inference Server model repository","domain":"docs.nvidia.com","steps":["Create the model repository directory structure: <model_repo_root>/<model_name>/<version>/<model_file> — for example models/resnet50/1/model.onnx","Write a config.pbtxt file in the model name directory specifying at minimum: name, backend (e.g., 'onnxruntime', 'tensorrt', 'python'), max_batch_size, and input/output tensor definitions with name, data_type, and dims","Start the Triton server pointing at the repository: docker run --gpus all -v /local/model_repo:/models nvcr.io/nvidia/tritonserver:<version>-py3 tritonserver --model-repository=/models","Verify model readiness by querying the health endpoint: curl localhost:8000/v2/models/<model_name>/ready — a 200 response confirms the model is loaded","Send inference requests using the V2 HTTP inference protocol: POST localhost:8000/v2/models/<model_name>/infer with a JSON body specifying inputs as arrays","Inspect auto-generated configuration for a model without config.pbtxt by querying: curl localhost:8000/v2/models/<model_name>/config"],"gotchas":["The version subdirectory must be a positive integer string (e.g., '1', '2') — non-integer directory names are ignored by Triton and the model will not load","config.pbtxt is required unless --strict-model-config=false is set at server startup to enable auto-configuration; auto-configuration is not supported for all backends","dims values in config.pbtxt use -1 as a wildcard for dynamic dimensions; specifying a fixed size that does not match the model's actual input shape causes an initialization error"],"contributor":"waymark-seed","created":"2026-06-12T07:24:38.380Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":{"status":"sampled","method":"legacy-file-sample","at":"2026-06-13T18:44:44.112Z"},"url":"https://mcp.waymark.network/r/eece05e3-5b80-43b7-82fe-8ee3b152c5ed"}