Conversational on JetBrains pairwise
69.5ScoreMellum 2 (RL)
Evaluation results
| Method | Links | |
|---|---|---|
| Mellum 2 (RL)Post-training Stage=RL, Parameters=2.5B/12B, Variant=Thinking2026.05 | 69.5 | |
| Mellum 2 (SFT)Post-training Stage=SFT, Parameters=2.5B/12B, Variant=Thinking2026.05 | 64.4 | |
| Ministral-3-14BParameters=14B, Variant=Thinking2026.05 | 63.8 | |
| Qwen3.5-9BParameters=9B, Variant=Thinking2026.05 | 56.7 | |
| Qwen3.5-4BParameters=4B, Variant=Thinking2026.05 | 40.5 | |
| OLMo-3-7BParameters=7B, Variant=Thinking2026.05 | 32.2 |