# Root Cause Reasoning on ITBench Source: [Root Cause Reasoning on ITBench]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:11:03.666Z Evaluation of model performance on Root Cause Reasoning using the ITBench dataset, measured by maj@3 Recall and token usage. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Root Cause Reasoning | | Dataset (including any stated split) | ITBench | | Metric | maj@3 Recall | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 10 of 10 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [maj@3 Recall](): Higher is better; unit: PERCENT. - [Input Tokens](): Higher is better; unit: SCALAR. - [Output Tokens](): Lower is better; unit: SCALAR. ## Recorded results | Method | maj@3 Recall | Result date | Report paper | | --- | --- | --- | --- | | EoG | 90.2 | Not recorded | 697846ffa2b28e761d87c8c2 | | EoG | 85 | Not recorded | 697846ffa2b28e761d87c8c2 | | EoG | 83 | Not recorded | 697846ffa2b28e761d87c8c2 | | EoG | 81.2 | Not recorded | 697846ffa2b28e761d87c8c2 | | EoG | 76.6 | Not recorded | 697846ffa2b28e761d87c8c2 | | ReAct | 72.9 | Not recorded | 697846ffa2b28e761d87c8c2 | | EoG | 68 | Not recorded | 697846ffa2b28e761d87c8c2 | | ReAct | 22.9 | Not recorded | 697846ffa2b28e761d87c8c2 | | ReAct | 10 | Not recorded | 697846ffa2b28e761d87c8c2 | | ReAct | 8.6 | Not recorded | 697846ffa2b28e761d87c8c2 | ### EoG maj@3 Recall: 90.2. Result ID: 699622585698665ec462daaa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Agent":"EoG","Model":"Gemini 3 Flash"}. This record does not assert independent reproduction. ### EoG maj@3 Recall: 85. Result ID: 699622585698665ec462daa8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Agent":"EoG","Model":"GPT-OSS-120B"}. This record does not assert independent reproduction. ### EoG maj@3 Recall: 83. Result ID: 699622585698665ec462daa6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Agent":"EoG","Model":"GPT-5.1"}. This record does not assert independent reproduction. ### EoG maj@3 Recall: 81.2. Result ID: 699622585698665ec462daac. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Agent":"EoG","Model":"Kimi K2"}. This record does not assert independent reproduction. ### EoG maj@3 Recall: 76.6. Result ID: 699622585698665ec462daae. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Agent":"EoG","Model":"Mistral Large"}. This record does not assert independent reproduction. ### ReAct maj@3 Recall: 72.9. Result ID: 699622585698665ec462daa9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Agent":"ReAct","Model":"Gemini 3 Flash"}. This record does not assert independent reproduction. ### EoG maj@3 Recall: 68. Result ID: 699622585698665ec462daad. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Agent":"EoG","Model":"Minimax M2.1"}. This record does not assert independent reproduction. ### ReAct maj@3 Recall: 22.9. Result ID: 699622585698665ec462daab. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Agent":"ReAct","Model":"Kimi K2"}. This record does not assert independent reproduction. ### ReAct maj@3 Recall: 10. Result ID: 699622585698665ec462daa5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Agent":"ReAct","Model":"GPT-5.1"}. This record does not assert independent reproduction. ### ReAct maj@3 Recall: 8.6. Result ID: 699622585698665ec462daa7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Agent":"ReAct","Model":"GPT-OSS-120B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.