Tessary

Tessary is an open-source agent reliability platform. It monitors every production trace, detects failures that sampled evals miss, and investigates the root cause with your agent codebase. It runs cheap, narrow classifiers across every trace. When it detects a recurring issue or change in behaviour, it groups the affected traces into a finding, validates the issue, and investigates what caused it. This keeps monitoring cheap, with deeper analysis reserved for issues that warrant investigation.