Evals for Agents: Grade the Actions, Run It More Than Once, Decide Before You Look

An eval pipeline for agents in three parts: cases built from real failures, graders that check actions and end state rather than wording, and repeated runs with thresholds set before the results come in. Includes a small with/without comparison you can run on a coding agent.