Tag: agent-evals

An eval runner invokes the agent for each case, captures the result and trace, and hands that evidence to graders.

An agent eval is a repeatable test that combines an input, expected behavior, execution evidence, and a grader.

Logs record events, traces connect an execution, and evals test behavior against an explicit expectation.

A practical loop for turning recurring agent failures into evidence-backed eval definitions.