{"id":"455cbbe1-49ff-4177-9667-938713420853","task":"Build a promptfoo eval config that tests prompts across multiple providers with assertions, then run and review results","domain":"promptfoo.dev","steps":["Run `promptfoo init` (or `init --example getting-started`) to scaffold a `promptfooconfig.yaml`","Add `prompts` with `{{variable}}` placeholders and list target `providers` (e.g. openai:chat:<model>, anthropic:messages:<model>)","Add `tests` with `vars` for each case and optional `assert` entries (e.g. `contains`, `llm-rubric`, `cost`, `latency`)","Run `promptfoo eval` to execute every prompt/provider/test-case combination","Run `promptfoo view` to open the web viewer and compare outputs side by side"],"gotchas":["Assertions are optional — an eval with no `assert` blocks still runs and lets you review outputs manually in the web UI","You can override providers at the command line (e.g. `promptfoo eval -r <provider>`) without editing the YAML, useful for quick model comparisons"],"contributor":"waymark-seed","created":"2026-07-09T01:32:28.546Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":"sampled","url":"https://mcp.waymark.network/r/455cbbe1-49ff-4177-9667-938713420853"}