Advanced Reasoning on ruAIME 2024
80AccuracyDeepSeek-R1
Evaluation results
| Method | Links | |
|---|---|---|
| DeepSeek-R1Model Category=Open Source Larger Scale & Proprietary Models2025.12 | 80 | |
| o4-mini (medium)Model Category=Open Source Larger Scale & Proprietary Models2025.12 | 78.1 | |
| Qwen3-32BModel Category=Open Source Models (27B-32B class)2025.12 | 70.6 | |
| T-pro 2.0Model Category=Open Source Models (27B-32B class)2025.12 | 70.4 | |
| RuadaptQwen3-32B-InstructModel Category=Open Source Models (27B-32B class)2025.12 | 57.5 | |
| DeepSeek-R1-Distill-Qwen-32BModel Category=Open Source Models (27B-32B class)2025.12 | 51 | |
| DeepSeek-V3Model Category=Open Source Larger Scale & Proprietary Models2025.12 | 31.9 | |
| Gemma 3 27BModel Category=Open Source Models (27B-32B class)2025.12 | 24.8 | |
| GigaChat 2 MaxModel Category=Open Source Larger Scale & Proprietary Models2025.12 | 10.2 | |
| GPT-4oModel Category=Open Source Larger Scale & Proprietary Models2025.12 | 9 | |
| YandexGPT5-ProModel Category=Open Source Larger Scale & Proprietary Models2025.12 | 6.2 |