Skip to content

Sign in See it live

LLM

Working with the models themselves — capability, cost, and failure.

4 posts

Feb 2026

Structured Output Isn't Reliable Output

JSON mode, function calling and constrained decoding give you schema compliance, not semantic reliability. Valid JSON can be completely wrong.
Nov 2025

The Eval Crisis: Why Most Benchmarks Don't Matter

Your model scores 90% on MMLU. It still fails in production. The benchmarks everyone obsesses over measure the wrong things for enterprise AI.
Oct 2025

5 Evals Every Production LLM Needs

Forget MMLU scores. These are the evaluations that actually predict whether your LLM will work in production.
Feb 2025

The LLM Evaluation Maturity Model: Where Does Your Team Actually Stand?

A six-level framework for assessing how your organization evaluates LLM outputs. From 'it looks right' to continuous evaluation pipelines with regression detection.

Other topics