Chinese Language Understanding on C-Eval (EM)
91.8Exact MatchOpenAI-o1-1217
Evaluation Results
| Method | Links | |
|---|---|---|
| OpenAI-o1-12172025.01 | 91.8 | |
| DeepSeek-R1Architecture=MoE, Activated Params=37B, Total Params=671B2025.01 | 91.8 | |
| DeepSeek-V3Architecture=MoE, Activated Params=37B, Total Params=671B2025.01 | 86.5 | |
| Claude-3.5-Sonnet-10222025.01 | 76.7 | |
| GPT-4o-05132025.01 | 76 | |
| OpenAI-o1-mini2025.01 | 68.9 |