Mathematical Reasoning on AIME '25 (Mean Accuracy, Standard Deviation)
84Mean AccuracyHermes@1
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Hermes@1Model=OpenAI o3-mini2025.11 | 84 | 84 | |
| CoT@5+Safe*Model=OpenAI o3-mini2025.11 | 80.7 | 80.7 | |
| CoT@5+SafeModel=OpenAI o3-mini2025.11 | 80 | 80 | |
| Hermes@1Model=DeepSeek-V3.22025.11 | 74.7 | 74.7 | |
| CoT@5+SkyworkModel=OpenAI o3-mini2025.11 | 72 | 72 | |
| CoT@5+ArmoRMModel=OpenAI o3-mini2025.11 | 72 | 72 | |
| CoT@1Model=OpenAI o3-mini2025.11 | 71.3 | 71.3 | |
| CoT@5+ShepherdModel=OpenAI o3-mini2025.11 | 70 | 70 | |
| Hermes@1Model=DeepSeek-V3.12025.11 | 66.7 | 66.7 | |
| CoT@5+RLHFlowModel=OpenAI o3-mini2025.11 | 65.3 | 65.3 | |
| CoT@5+MajorityModel=OpenAI o3-mini2025.11 | 64.7 | 64.7 | |
| CoT@5+SkyworkModel=DeepSeek-V3.22025.11 | 60 | 60 | |
| CoT@5+MajorityModel=DeepSeek-V3.22025.11 | 58.7 | 58.7 | |
| CoT@5+ShepherdModel=DeepSeek-V3.12025.11 | 57.3 | 57.3 | |
| CoT@5+ShepherdModel=DeepSeek-V3.22025.11 | 57.3 | 57.3 | |
| CoT@5+ArmoRMModel=DeepSeek-V3.12025.11 | 55.3 | 55.3 | |
| CoT@5+ArmoRMModel=DeepSeek-V3.22025.11 | 55.3 | 55.3 | |
| CoT@5+RLHFlowModel=DeepSeek-V3.22025.11 | 53.3 | 53.3 | |
| CoT@5+Safe*Model=DeepSeek-V3.22025.11 | 52.7 | 52.7 | |
| CoT@5+SkyworkModel=DeepSeek-V3.12025.11 | 52 | 52 | |
| CoT@5+RLHFlowModel=DeepSeek-V3.12025.11 | 50 | 50 | |
| CoT@5+Safe*Model=DeepSeek-V3.12025.11 | 50 | 50 | |
| CoT@1Model=DeepSeek-V3.22025.11 | 49.3 | 49.3 | |
| CoT@1Model=DeepSeek-V3.12025.11 | 48 | 48 | |
| CoT@5+MajorityModel=DeepSeek-V3.12025.11 | 48 | 48 | |
| CoT@5+SafeModel=DeepSeek-V3.22025.11 | 46.7 | 46.7 | |
| CoT@5+SafeModel=DeepSeek-V3.12025.11 | 45.3 | 45.3 | |
| CoT@5+SkyworkModel=Qwen3-8B2025.11 | 30.7 | 30.7 | |
| CoT@5+ArmoRMModel=Qwen3-8B2025.11 | 30.7 | 30.7 | |
| Hermes@1Model=Qwen3-8B2025.11 | 28 | 28 | |
| CoT@5+ShepherdModel=Qwen3-8B2025.11 | 25.3 | 25.3 | |
| CoT@5+RLHFlowModel=Qwen3-8B2025.11 | 24 | 24 | |
| CoT@5+SafeModel=Qwen3-8B2025.11 | 22 | 22 | |
| CoT@5+Safe*Model=Qwen3-8B2025.11 | 21.3 | 21.3 | |
| CoT@5+MajorityModel=Qwen3-8B2025.11 | 20 | 20 | |
| CoT@1Model=Qwen3-8B2025.11 | 18.7 | 18.7 |