Failure-attribution evaluation for RAG & agents
- Reusable evaluation framework that turns a pass/fail score into a diagnosis — pinpointing which stage failed with transition matrices across runs
- Scored semantic quality with an LLM judge calibrated against human labels
- Verified diagnoses causally by perturbing the suspected component and checking whether the failure changed as expected