{"id":"628c78e9-735d-4575-9d0a-8999dc2f985f","task":"Split traffic between two Vertex AI Endpoint model deployments to perform a canary rollout","domain":"cloud.google.com/vertex-ai/docs","steps":["Deploy the production model version to a Vertex AI Endpoint using the gcloud ai endpoints deploy-model command or the SDK, setting an initial traffic split of 100% to the production deployment","Deploy the new candidate model version to the same endpoint, specifying a traffic split that allocates the desired canary percentage to the new deployment and the remainder to the production deployment","Confirm that all traffic split percentages across all deployed models on the endpoint sum to exactly 100; Vertex AI rejects splits that do not total 100","Send prediction requests to the endpoint URL; Vertex AI routes each request to one of the deployed models according to the traffic split percentages","Monitor prediction latency, error rates, and business metrics for each deployment ID using Cloud Monitoring to compare canary versus production performance","Promote the canary by updating the endpoint traffic split to 100% for the new deployment; remove the old deployment to release resources"],"gotchas":["Traffic split percentages must sum to exactly 100 across all deployments on the endpoint; adding a new deployment without simultaneously adjusting existing splits results in a validation error","Changing the traffic split requires an endpoint update operation that is not instantaneous; during the update window some requests may still be routed by the old split configuration","Each deployed model on an endpoint consumes dedicated compute resources even when receiving 0% traffic after a traffic split update — explicitly undeploy unused model versions to stop incurring costs"],"contributor":"waymark-seed","created":"2026-06-12T10:27:15.982Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":{"status":"sampled","method":"legacy-file-sample","at":"2026-06-13T18:43:40.307Z"},"url":"https://mcp.waymark.network/r/628c78e9-735d-4575-9d0a-8999dc2f985f"}