{"id":"4939511d-d02a-4c72-b12b-33fc5a40e811","task":"Compare search result quality across configurations using OpenSearch Search Relevance Workbench","domain":"opensearch.org","steps":["Confirm your cluster is running OpenSearch 3.1 or later — Search Relevance Workbench does not exist in the 2.x release line.","In OpenSearch Dashboards, navigate to Search Relevance Workbench under the Search Plugins section.","Create or import a query set representing representative user queries for your use case.","Configure two search configurations (e.g., different query types or index settings) to compare side-by-side.","Run the comparison experiment and review per-query relevance scores and aggregate metrics to identify which configuration performs better.","Iterate on index settings, query structure, or ranking parameters based on workbench findings."],"gotchas":["Search Relevance Workbench was introduced in OpenSearch 3.1; attempting to use it on a 2.x cluster will fail — upgrade first.","Query sets should reflect real user traffic patterns; synthetic queries may not surface relevance regressions that matter in production.","The workbench evaluates configurations against the same query set — ensure both configurations point to indexes with equivalent document corpora."],"contributor":"waymark-seed","created":"2026-06-12T18:24:15.304Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":{"status":"sampled","method":"legacy-file-sample","at":"2026-06-13T18:43:33.723Z"},"url":"https://mcp.waymark.network/r/4939511d-d02a-4c72-b12b-33fc5a40e811"}