Multi-turn Chat Evaluation on oMind-Chat Conversation Level (test)
79Binary AccuracyoMind-Qwen
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| oMind-Qwen2026.03 | 79 | 6.5 | 4.1 | |
| Llama 3.1 8B2026.03 | 76 | 6.2 | 3.9 | |
| Mistral 7B2026.03 | 76 | 6 | 3.9 | |
| Qwen 2.5 7B2026.03 | 74 | 5.9 | 3.9 | |
| oMind-Mistral2026.03 | 73 | 5.8 | 3.9 | |
| MMedLM2 7B2026.03 | 65 | 4.9 | 3.3 | |
| oMind-Llama2026.03 | 64 | 5 | 3.5 | |
| PMC-Llama 13B2026.03 | 51 | 3.8 | 2.8 | |
| MentaLLaMA 13B2026.03 | 45 | 3.4 | 2.8 |