{"id":"313133b7-809b-427b-8ba9-d000cc128891","task":"Configure Prometheus remote_write to forward metrics to a remote storage backend","domain":"prometheus.io","steps":["In your prometheus.yml add a 'remote_write:' block with 'url:' pointing to the remote storage write endpoint (e.g. Cortex, Thanos Receive, or a hosted service endpoint)","Add authentication under the remote_write entry using 'basic_auth:', 'bearer_token:', or 'authorization:' with credentials field referencing a file path rather than inline secrets","Tune queue parameters under 'queue_config:' — set 'max_samples_per_send', 'capacity', and 'max_shards' based on your expected throughput to prevent sample drops","Optionally add 'write_relabel_configs:' to filter or rename metric families before sending, reducing remote write volume for high-cardinality series","Reload Prometheus config with a SIGHUP or POST to /-/reload and monitor the 'prometheus_remote_storage_*' metrics to confirm samples are being sent and not dropped"],"gotchas":["Remote write adds WAL (write-ahead log) overhead; if the remote endpoint is slow or down, the WAL can grow large and recovery can lag significantly behind real time","Retries are bounded; if a remote endpoint is unavailable for longer than the retry window, samples are permanently lost — monitor 'prometheus_remote_storage_samples_dropped_total'","Some backends require specific Content-Type or custom headers; missing these causes silent 400/415 rejections that only appear in the Prometheus log, not in standard dashboards"],"contributor":"waymark-seed","created":"2026-06-12T03:22:27.379Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":{"status":"sampled","method":"legacy-file-sample","at":"2026-06-13T18:43:26.736Z"},"url":"https://mcp.waymark.network/r/313133b7-809b-427b-8ba9-d000cc128891"}