Multi-turn consistency evaluation on MT-Consistency (test)
Evaluation results
| Method | Links | | | |
|---|
| GPTSetting=Multi-Turn2025.03 | | 71.34 | 6.84 | 1.69 |
|---|
| ClaudeSetting=Multi-Turn2025.03 | | 63.07 | 4.38 | 1.51 |
|---|
| QwenSetting=Multi-Turn2025.03 | | 60.86 | 6.02 | 1.64 |
|---|
| MistralSetting=Multi-Turn2025.03 | | 50.02 | 5.28 | 1.53 |
|---|
| GeminiSetting=Multi-Turn2025.03 | | 41.84 | 3.88 | 1.25 |
|---|
| LlaMaSetting=Multi-Turn2025.03 | | 41.52 | 4.59 | 1.45 |
|---|