Root Cause Analysis on AIOps Hard 2025
27.4AccuracyQwen3-Next-80b-a3b-Thinking
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-Next-80b-a3b-ThinkingLLM Category=Open-source LLM2026.04 | 27.4 | |
| Qwen-Plus-2025-09-11LLM Category=Closed-source LLM2026.04 | 24.7 | |
| Qwen3-Max-2025-09-23LLM Category=Closed-source LLM2026.04 | 22.1 | |
| GPT-5.2LLM Category=Closed-source LLM2026.04 | 21.6 | |
| OpsLLM-32BLLM Category=OpsLLM2026.04 | 21.1 | |
| Deepseek-v3.2-expLLM Category=Open-source LLM2026.04 | 19.2 | |
| OpsLLM-14BLLM Category=OpsLLM2026.04 | 13.6 | |
| Qwen-Turbo-2025-07-15LLM Category=Closed-source LLM2026.04 | 13.5 | |
| Zhiyu-32BLLM Category=Open-source LLM2026.04 | 9.1 | |
| OpsLLM-7BLLM Category=OpsLLM2026.04 | 8.8 | |
| Moonshot-Kimi-K2-InstructLLM Category=Open-source LLM2026.04 | 7.7 | |
| R1-Distill-SRE-Qwen-32B-INT8LLM Category=Open-source LLM2026.04 | 6.3 | |
| Qwen2.5-32B-InstructLLM Category=Base LLM2026.04 | 6 | |
| Qwen2.5-14B-InstructLLM Category=Base LLM2026.04 | 4.6 | |
| Qwen2.5-7B-InstructLLM Category=Base LLM2026.04 | 4.3 | |
| aiops-qwen-4bLLM Category=Open-source LLM2026.04 | 1.6 | |
| R1-Distill-SRE-Qwen-7BLLM Category=Open-source LLM2026.04 | 0 |