EviRCA separates root-cause analysis into a deterministic stage that turns raw metrics, traces, and logs into compact 'evidence cards,' and an LLMA large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.Full definition → stage that only reasons over those cards via read-only tools.
On the OpenRCA benchmarkA standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.Full definition → (three enterprise systems), EviRCA reached a 40.6-43.9% correct rate versus a prior best of 15.2% for agentic baselines that let the LLM explore raw telemetry directly.
The decoupled design also cut tokenThe chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.Full definition → consumption 15-26x and execution time 3-20x compared to those baselines, per the paper.
EviRCA solves 'hard cases' requiring reasoning across time, components, and causes at once -- a setting where prior approaches scored near zero.
Failure analysis found the bottleneck is judging evidence already surfaced, not finding it -- meaning RCA accuracy hinges on the extraction stage's quality, not the LLM's reasoning power.
Terms in this piece · Glossary
LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
Why it matters
Addresses instability and cost of agents exploring raw telemetry directly, offering a more reliable split between deterministic extraction and LLM reasoning for SRE-style diagnostic agents.
articleRoot-Cause Attribution Is a Search Problem: Continual Search for Long-Horizon Agent FailuresHarsh Raj, David Lee, Anas Mahmoud, Renxiong Wang, Razvan-Gabriel Dumitru, Chenguang Wang, Tong Zhao, Yunzhong He, Darvin Yi, Vipul Gupta
articleKRCA: An Efficient Root Cause Analysis System in Hyper-Scale Microservice Systems via Agentic AIJiamin Jiang, Jingfei Feng, Yu Luo, Qingliang Zhang, Yongqian Su, Wenwei Gu, Shenglin Zhang, Tianyu Cui, Yao Wu, Jielong Huang, Nan Qi, Dan Pei
articleORCA: Observability-Grounded Program Repair for Microservice IncidentsYuanchen Gao, Yifang Tian, Yiran Li, Charles Zhang, Hans-Arno Jacobsen