Mathematical Reasoning on MATH500 (Mean Accuracy, Std Dev)
98.2Mean Accuracy (MATH500)Hermes@1
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Hermes@1Model=DeepSeek-V3.22025.11 | 98.2 | 98.2 | |
| CoT@5+SkyworkModel=DeepSeek-V3.22025.11 | 97.3 | 97.3 | |
| CoT@5+Safe*Model=DeepSeek-V3.22025.11 | 97.3 | 97.3 | |
| Hermes@1Model=DeepSeek-V3.12025.11 | 97.2 | 97.2 | |
| CoT@5+MajorityModel=DeepSeek-V3.22025.11 | 97.2 | 97.2 | |
| CoT@5+SafeModel=DeepSeek-V3.22025.11 | 97.1 | 97.1 | |
| Hermes@1Model=OpenAI o3-mini2025.11 | 97 | 97 | |
| CoT@5+ArmoRMModel=DeepSeek-V3.22025.11 | 97 | 97 | |
| CoT@5+MajorityModel=DeepSeek-V3.12025.11 | 96.9 | 96.9 | |
| CoT@5+SkyworkModel=DeepSeek-V3.12025.11 | 96.7 | 96.7 | |
| CoT@5+ShepherdModel=DeepSeek-V3.22025.11 | 96.7 | 96.7 | |
| CoT@1Model=DeepSeek-V3.22025.11 | 96.6 | 96.6 | |
| CoT@5+MajorityModel=OpenAI o3-mini2025.11 | 96.5 | 96.5 | |
| CoT@5+SkyworkModel=OpenAI o3-mini2025.11 | 96.4 | 96.4 | |
| CoT@5+Safe*Model=OpenAI o3-mini2025.11 | 96.4 | 96.4 | |
| CoT@5+ArmoRMModel=DeepSeek-V3.12025.11 | 96.4 | 96.4 | |
| CoT@5+ShepherdModel=DeepSeek-V3.12025.11 | 96.4 | 96.4 | |
| CoT@5+Safe*Model=DeepSeek-V3.12025.11 | 96.4 | 96.4 | |
| CoT@1Model=OpenAI o3-mini2025.11 | 96.2 | 96.2 | |
| CoT@5+ArmoRMModel=OpenAI o3-mini2025.11 | 96.1 | 96.1 | |
| CoT@5+ShepherdModel=OpenAI o3-mini2025.11 | 96.1 | 96.1 | |
| CoT@5+RLHFlowModel=DeepSeek-V3.12025.11 | 96 | 96 | |
| CoT@5+SafeModel=DeepSeek-V3.12025.11 | 96 | 96 | |
| CoT@5+RLHFlowModel=OpenAI o3-mini2025.11 | 95.8 | 95.8 | |
| CoT@1Model=DeepSeek-V3.12025.11 | 95.6 | 95.6 | |
| CoT@5+SafeModel=OpenAI o3-mini2025.11 | 95.5 | 95.5 | |
| CoT@5+RLHFlowModel=DeepSeek-V3.22025.11 | 95.5 | 95.5 | |
| Hermes@1Model=Qwen3-8B2025.11 | 91.3 | 91.3 | |
| CoT@5+SkyworkModel=Qwen3-8B2025.11 | 90.9 | 90.9 | |
| CoT@5+ArmoRMModel=Qwen3-8B2025.11 | 89.2 | 89.2 | |
| CoT@5+Safe*Model=Qwen3-8B2025.11 | 89.2 | 89.2 | |
| CoT@5+SafeModel=Qwen3-8B2025.11 | 89.1 | 89.1 | |
| CoT@5+ShepherdModel=Qwen3-8B2025.11 | 86.9 | 86.9 | |
| CoT@5+MajorityModel=Qwen3-8B2025.11 | 86.8 | 86.8 | |
| CoT@1Model=Qwen3-8B2025.11 | 85.7 | 85.7 | |
| CoT@5+RLHFlowModel=Qwen3-8B2025.11 | 83.6 | 83.6 |