Themesrising
Teams build evals and judges for agents
Engineering teams are publishing how they test systems whose output is open-ended. Netflix runs LLM judges in production and aligns them with human ratings over time, Vercel lays out an agent test pyramid with seeded task environments and per-constraint verifiers, and Ramp replaced tests with deliberating LLM judges for its internal coding benchmark, lifting judge agreement from 54% to 94%. Reliable evaluation is becoming its own engineering discipline, and a prerequisite for shipping agents with confidence.