Root Cause Entity Identification on ITBench
94.5Pass@3 F1EoG
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| EoGAgent=EoG, Model=Gemini 3 Flash2026.01 | 94.5 | 97.1 | 92.1 | 94.3 | — | — | |
| EoGAgent=EoG, Model=GPT-5.12026.01 | 88.9 | 91.4 | 86.1 | 88.6 | — | — | |
| ReActAgent=ReAct, Model=Gemini 3 Flash2026.01 | 88.6 | 94.3 | 74.3 | 74.3 | — | — | |
| EoGAgent=EoG, Model=Kimi K22026.01 | 85.3 | 91.4 | 83 | 88.6 | — | — | |
| EoGAgent=EoG, Model=GPT-OSS-120B2026.01 | 84.1 | 94.3 | 79.4 | 88.6 | — | — | |
| EoGAgent=EoG, Model=Mistral Large2026.01 | 76.6 | 91.4 | 67.2 | 80 | — | — | |
| EoGAgent=EoG, Model=Minimax M2.12026.01 | 72.9 | 88.6 | 64.2 | 77.1 | — | — | |
| ReActAgent=ReAct, Model=Kimi K22026.01 | 48.6 | 48.6 | 28.6 | 28.6 | — | — | |
| ReActAgent=ReAct, Model=GPT-OSS-120B2026.01 | 28.6 | 28.6 | 5.7 | 5.7 | — | — | |
| ReActAgent=ReAct, Model=GPT-5.12026.01 | 22.9 | 22.9 | 8.6 | 11.4 | — | — |