AI & Agents
Evals Coach
Last updated 2026-09-07 · benchmark measured 2026-09-07 — deterministic & reproducible
A Claude plugin that guides AI product managers through designing evaluations step by step.
Is Evals Coach production-ready?
Legit.Show scores Evals Coach 72 out of 100 — the simple average of its 7 measured frames. Legit.Show ran its deterministic 7-Frame production-readiness benchmark on Evals Coach (public-surface assessment), measured from the public surface with no LLM in the scoring path. Its strongest frame is Reliability; its weakest is Privacy. Every frame it averages is published with its evidence on the Legit.Show listing.
The 7 Frames
- Performance — 90/100
- Accessibility — 94/100
- Security — 45/100
- Privacy — 25/100
- Reliability — 100/100
- Standards — 92/100
- Discoverability — 60/100
What we measured
- Security headers present: HSTS.
- No Content-Security-Policy.
- Served over HTTPS with a valid certificate.
- Real Lighthouse performance run — 160 ms to first byte.
- Returns a proper 404 for unknown routes.
- 1 of 1 sampled routes reachable.
- No privacy policy found.
- Sets cookies / loads scripts with no consent prompt.
Who it's for
AI product managers · Product teams building AI features · Teams without eval experience · Companies needing quality gates
Pricing
Free
Visit Evals Coach → · Alternatives to Evals Coach → · How this was measured →