Root Cause Localization on Dataset A
56.2Acc@1mABC+STAR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| mABC+STARModel=GPT-52026.05 | 56.2 | 66.1 | 70.8 | |
| mABC+STARModel=Qwen3-max2026.05 | 54.9 | 65 | 69.6 | |
| mABC+STARModel=Gemini-2.5pro2026.05 | 53.7 | 63.8 | 68.4 | |
| RCAgent+STARModel=GPT-52026.05 | 48.7 | 58.4 | 62.5 | |
| RCAgent+STARModel=Qwen3-max2026.05 | 47.4 | 57.1 | 61.2 | |
| RCAgent+STARModel=Gemini-2.5pro2026.05 | 46.1 | 55.8 | 59.9 | |
| mABCModel=GPT-52026.05 | 37.2 | 45.1 | 47.8 | |
| mABCModel=Qwen3-max2026.05 | 36.2 | 44.1 | 46.8 | |
| mABCModel=Gemini-2.5pro2026.05 | 35.4 | 43.3 | 46 | |
| RCAgentModel=GPT-52026.05 | 23.8 | 30.1 | 32.6 | |
| RCAgentModel=Qwen3-max2026.05 | 22.8 | 29.1 | 31.6 | |
| RCAgentModel=Gemini-2.5pro2026.05 | 22 | 28.3 | 30.8 |