Multi-turn Enterprise IT Support Diagnosis on 150 Enterprise IT Support Scenarios (test)
78.7Success RateDQA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DQASystem configuration=Full DQA system with persistent state2026.04 | 78.7 | 99 | 94 | 3.93 | |
| RAG + ClusteringSystem configuration=Retrieval aggregation via clustering2026.04 | 53.8 | 90 | 80 | 6.53 | |
| RAG (baseline)System configuration=Baseline RAG2026.04 | 41.3 | 86 | 73 | 8.43 | |
| RAG (no CQR)System configuration=No CQR2026.04 | 40.4 | 86 | 73 | 8.17 |