Multi-turn dialogue on ConsistentChat
8.52LLM-EVAL ScoreMDS
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MDSBackbone=LLAMA3-8B-INSTRUCT, Selection Method=MDS2026.04 | 8.52 | 7.26 | 31.6 | 79.7 | 1.25 | |
| Random DataBackbone=LLAMA3-8B-INSTRUCT, Selection Method=Random Data2026.04 | 8.46 | 7.2 | 30.6 | 78.3 | 6.92 | |
| DialScoreBackbone=LLAMA3-8B-INSTRUCT, Selection Method=DialScore2026.04 | 8.44 | 7.13 | 30.7 | 78.7 | 6 | |
| MDSBackbone=QWEN3-8B-INSTRUCT, Selection Method=MDS2026.04 | 8.44 | 8.04 | 33.8 | 82.2 | 1.25 | |
| HeuristicBackbone=LLAMA3-8B-INSTRUCT, Selection Method=Heuristic2026.04 | 8.43 | 7.1 | 30 | 79.2 | 7 | |
| All DataBackbone=LLAMA3-8B-INSTRUCT, Selection Method=All Data2026.04 | 8.42 | 7.2 | 31 | 79.4 | 5.67 | |
| ZIPBackbone=LLAMA3-8B-INSTRUCT, Selection Method=ZIP2026.04 | 8.42 | 7.18 | 29.4 | 78.1 | 5.58 | |
| RethinkingBackbone=LLAMA3-8B-INSTRUCT, Selection Method=Rethinking2026.04 | 8.41 | 7.18 | 31 | 78.9 | 5.5 | |
| CC-ScoreBackbone=LLAMA3-8B-INSTRUCT, Selection Method=CC-Score2026.04 | 8.41 | 7.16 | 30.5 | 78.8 | 4.58 | |
| SuperFilteringBackbone=LLAMA3-8B-INSTRUCT, Selection Method=SuperFiltering2026.04 | 8.38 | 7.11 | 30.1 | 78.8 | 4.92 | |
| HeuristicBackbone=QWEN3-8B-INSTRUCT, Selection Method=Heuristic2026.04 | 8.36 | 8 | 30.7 | 79.3 | 5.67 | |
| CC-ScoreBackbone=QWEN3-8B-INSTRUCT, Selection Method=CC-Score2026.04 | 8.33 | 7.97 | 29.9 | 79.8 | 4.75 | |
| ZIPBackbone=QWEN3-8B-INSTRUCT, Selection Method=ZIP2026.04 | 8.32 | 7.98 | 31.4 | 79.1 | 6.17 | |
| DialScoreBackbone=QWEN3-8B-INSTRUCT, Selection Method=DialScore2026.04 | 8.32 | 7.97 | 30 | 80.2 | 4.67 | |
| Random DataBackbone=QWEN3-8B-INSTRUCT, Selection Method=Random Data2026.04 | 8.31 | 7.98 | 31.2 | 79.9 | 5.58 | |
| RethinkingBackbone=QWEN3-8B-INSTRUCT, Selection Method=Rethinking2026.04 | 8.29 | 8 | 29.5 | 79.2 | 5.75 | |
| All DataBackbone=QWEN3-8B-INSTRUCT, Selection Method=All Data2026.04 | 8.28 | 7.96 | 30.1 | 79.3 | 7.25 | |
| SuperFilteringBackbone=QWEN3-8B-INSTRUCT, Selection Method=SuperFiltering2026.04 | 8.26 | 7.96 | 31 | 80.2 | 5.33 | |
| BackboneBackbone=LLAMA3-8B-INSTRUCT, Selection Method=Backbone2026.04 | 8.11 | 6.73 | 22.2 | 80.8 | 5 | |
| BackboneBackbone=QWEN3-8B-INSTRUCT, Selection Method=Backbone2026.04 | 6.68 | 7.11 | 18.4 | 71.1 | 7.25 |