Fault Causal Chain Reasoning on Real-world RANs (test)
54.14Node PrecisionQoEReasoner
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| QoEReasonerParadigm=Agent, Backbone=GPT-5.22026.06 | 54.14 | 54 | 42.86 | 40 | |
| QoEReasonerParadigm=Agent, Backbone=Qwen3-14B2026.06 | 44.64 | 44.29 | 32.86 | 30 | |
| QoEReasonerParadigm=Agent, Backbone=DeepSeek-V3.22026.06 | 42.71 | 42.64 | 30.95 | 28.57 | |
| GPT-5.2Paradigm=LLM2026.06 | 30.83 | 22.07 | 4.76 | 0 | |
| Qwen3-14BParadigm=LLM2026.06 | 17.38 | 8.79 | 1.43 | 0 | |
| DeepSeek-V3.2Paradigm=LLM2026.06 | 14.88 | 10.36 | 0.48 | 0 | |
| RCA-AgentParadigm=Agent, Backbone=GPT-5.22026.06 | 11.79 | 8.93 | 0 | 0 | |
| RCA-AgentParadigm=Agent, Backbone=DeepSeek-V3.22026.06 | 11.26 | 10.71 | 2.14 | 0 | |
| RCA-AgentParadigm=Agent, Backbone=Qwen3-14B2026.06 | 0.48 | 0.36 | 0 | 0 |