General Knowledge on MMLU Redux
92.9Exact MatchOpenAI-o1-1217
Evaluation results
| Method | Links | |
|---|---|---|
| OpenAI-o1-12172025.01 | 92.9 | |
| DeepSeek-R1Architecture=MoE, Activated Params=37B, Total Params=671B2025.01 | 92.9 | |
| DeepSeek-V3Architecture=MoE, Activated Params=37B, Total Params=671B2025.01 | 89.1 | |
| Claude-3.5-Sonnet-10222025.01 | 88.9 | |
| GPT-4o-05132025.01 | 88 | |
| OpenAI-o1-mini2025.01 | 86.7 |