· Perseval · Agent evaluation fundamentals
Offline, Online, and Shadow Agent Evals
Offline evals test controlled cases, online evals judge production behavior, and shadow evals observe a candidate without affecting users.
Offline evals test controlled cases, online evals judge production behavior, and shadow evals observe a candidate without affecting users.