Multi-turn financial advisory dialogue on Conv-FinRe (10 users x 23 steps each)
0.744NDCGClaude Sonnet 4.6
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Claude Sonnet 4.62026.03 | 0.744 | 1 | 0.384 | 0.926 | 1.652 | 17 | |
| GPT-5.22026.03 | 0.728 | 1.046 | 0.402 | 0.883 | 1.574 | 16.1 | |
| Qwen3-32B2026.03 | 0.692 | 1.115 | 0.301 | 0.8 | 1.491 | 11.6 | |
| Mistral Large 32026.03 | 0.691 | 1.095 | 0.404 | 0.9 | 1.596 | 14.2 | |
| Ministral 3 14B2026.03 | 0.656 | 0.988 | 0.67 | 0.678 | 1.057 | 45.7 | |
| Qwen2.5-7B2026.03 | 0.654 | 1.029 | 0.267 | 0.648 | 1.122 | 27.1 | |
| Gemma 3 12B-IT2026.03 | 0.651 | 1.249 | 0.399 | 0.874 | 1.609 | 22.6 |