Root-Cause Classification on Real-world RANs (test)
67.14Top-1 AccuracyQoEReasoner
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| QoEReasonerParadigm=Agent, Backbone=GPT-5.22026.06 | 67.14 | 61.71 | 58.59 | |
| QoEReasonerParadigm=Agent, Backbone=Qwen3-14B2026.06 | 60 | 58.29 | 55.66 | |
| QoEReasonerParadigm=Agent, Backbone=DeepSeek-V3.22026.06 | 57.14 | 53.33 | 55.18 | |
| GPT-5.2Paradigm=LLM2026.06 | 36.23 | 67.57 | 12.2 | |
| TSTCCParadigm=DL2026.06 | 31.43 | 9.65 | 10.73 | |
| CATCCParadigm=DL2026.06 | 28.57 | 9.01 | 9.76 | |
| RCA-AgentParadigm=Agent, Backbone=GPT-5.22026.06 | 17.14 | 15.55 | 31.6 | |
| RuleParadigm=Heuristic2026.06 | 5.71 | 18 | 24.44 | |
| DeepSeek-V3.2Paradigm=LLM2026.06 | 2.86 | 8.7 | 0.98 | |
| RCA-AgentParadigm=Agent, Backbone=DeepSeek-V3.22026.06 | 1.43 | 2.11 | 20 | |
| RCA-AgentParadigm=Agent, Backbone=Qwen3-14B2026.06 | 1.43 | 0.69 | 20 | |
| Qwen3-14BParadigm=LLM2026.06 | 0 | 0 | 0 |