AIOps Incident Resolution on AIOpsLab
94.2TSR (%)AOI Framework
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| AOI Framework2025.12 | 94.2 | 22.1 | 72.4 | 92.8 | 3.1 | 0.89 | 0.93 | 96.7 | |
| Baseline Multi-Agent System (B-MAS)2025.12 | 86.4 | 33.7 | 61.8 | 89.3 | 5.6 | 0.82 | 0.81 | 90.1 | |
| Single-Agent LLM (SA-LLM)2025.12 | 81.5 | 38.2 | 52.9 | 86.7 | 6.9 | 0.79 | 0.77 | 88.6 | |
| Traditional AIOps Pipeline (TAP)2025.12 | 75.1 | 42.6 | 35.7 | 81.4 | 7.8 | 0.76 | 0.74 | 82.3 | |
| Rule-based Expert System (RES)2025.12 | 67.8 | 54.3 | — | — | 9.2 | 0.71 | 0.62 | 78.5 |