Skip to content

Sign in See it live

Evaluation

What benchmarks tell you, what they do not, and what to do instead.

4 posts

Nov 2025

The Eval Crisis: Why Most Benchmarks Don't Matter

Your model scores 90% on MMLU. It still fails in production. The benchmarks everyone obsesses over measure the wrong things for enterprise AI.
Oct 2025

5 Evals Every Production LLM Needs

Forget MMLU scores. These are the evaluations that actually predict whether your LLM will work in production.
Jun 2025

Eval Debt Will End Careers

Tech debt is slow. Eval debt is sudden. The teams that survive will treat evals like unit tests: written first, run always.
Feb 2025

The LLM Evaluation Maturity Model: Where Does Your Team Actually Stand?

A six-level framework for assessing how your organization evaluates LLM outputs. From 'it looks right' to continuous evaluation pipelines with regression detection.

Other topics