Chat Evaluation on AlpacaEval LC 2
74.11ScoreDictaLM 3.0 24B-Think
Evaluation results
| Method | Links | |
|---|---|---|
| DictaLM 3.0 24B-ThinkParameters=24B, Variant=Thinking2026.02 | 74.11 | |
| Qwen 3 VL 8B Think2025.12 | 73.5 | |
| Qwen 3 VL 8B Inststage=Instruct2025.12 | 73.5 | |
| Gemma 3 27BParameters=27B2026.02 | 65.5 | |
| Qwen 3 8B2025.12 | 60.5 | |
| Nemotron Nano 9B v22025.12 | 58 | |
| Olmo 3 7B ThinkStage=Final Think2025.12 | 52.1 | |
| Olmo 3 7B ThinkStage=DPO2025.12 | 50.6 | |
| Gemma 3 12BParameters=12B2026.02 | 50.57 | |
| Qwen 3 8Bstage=Instruct2025.12 | 49.8 | |
| Olmo 3 7B ThinkStage=SFT2025.12 | 43.9 | |
| Olmo 3 7B Instructstage=DPO2025.12 | 43.3 | |
| Mistral Small 3.12026.02 | 41.22 | |
| Olmo 3 7B Instructstage=Final Instruct2025.12 | 40.9 | |
| Granite 3.3 8B Inststage=Instruct2025.12 | 28.6 | |
| OpenThinker3 7B2025.12 | 24 | |
| Qwen 2.5 7Bstage=Instruct2025.12 | 23 | |
| Olmo 3 7B Instructstage=SFT2025.12 | 21.8 | |
| OLMo 2 7B Inststage=Instruct2025.12 | 18.3 | |
| DictaLM 3.0 12B-InstParameters=12B, Variant=Instruct2026.02 | 17.45 | |
| OR Nemotron 7B2025.12 | 8.6 | |
| Apertus 8B Inststage=Instruct2025.12 | 8.1 | |
| DS-R1 Qwen 7B2025.12 | 7.7 |