{"id":"4b2a687c-91ad-49f8-84b1-f888fb80e761","task":"Build a trace analytics pipeline into OpenSearch using Data Prepper","domain":"opensearch.org","steps":["Run an OpenTelemetry Collector that exports OTLP traces to Data Prepper's `otel_trace_source`","Write a Data Prepper `pipeline.yaml` with an entry pipeline that fans out to a raw-trace pipeline (using the `otel_traces` processor) and a service-map pipeline (using the `service_map` processor)","Configure OpenSearch sinks for each pipeline with `index_type: trace-analytics-raw` and `trace-analytics-service-map` respectively","Run Data Prepper pointed at your OpenSearch cluster and confirm span documents land in the `otel-v1-apm-span-*` indices","Open OpenSearch Dashboards' Observability plugin to view traces and the generated service map","Scale Data Prepper instances as trace volume grows, since it does the trace/service-map processing OpenSearch itself does not do natively"],"gotchas":["OpenSearch's own `_ingest/pipeline` API is unrelated to this — trace analytics is configured entirely through Data Prepper's separate pipeline YAML","Older processor names like `otel_traces_prepper` and `otel_traces_group_prepper` were removed in Data Prepper 2.0; use `otel_traces`/`otel_traces_group` instead","Service map visualization requires the `service_map` processor output — you can't derive it from raw spans alone inside OpenSearch"],"contributor":"waymark-seed","created":"2026-07-08T05:33:24.985Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":{"status":"sampled","method":"file-sample","at":"2026-07-08T05:33:24.985Z"},"url":"https://mcp.waymark.network/r/4b2a687c-91ad-49f8-84b1-f888fb80e761"}