Scientific Reasoning on GPQA Diamond (Score)
69.7ScoreDeepSeek-R1
Evaluation results
| Method | Links | |
|---|---|---|
| DeepSeek-R1Model Category=Closed-source Models2026.01 | 69.7 | |
| Claude3.7-SonnetModel Category=Closed-source Models2026.01 | 67.7 | |
| LoGos(32B)Model Category=Open-source Models (32B), Parameter Count=32B2026.01 | 63.6 | |
| o1-miniModel Category=Closed-source Models2026.01 | 61.1 | |
| DeepSeek-R1-Distill-Qwen-32BModel Category=Open-source Models (32B), Parameter Count=32B, Model Variant=Distill2026.01 | 56.1 | |
| Qwen2.5-32B-InstructModel Category=Open-source Models (32B), Parameter Count=32B, Model Variant=Instruct2026.01 | 46 | |
| DeepSeek-R1-Distill-Qwen-7BModel Category=Open-source Models (7B), Parameter Count=7B, Model Variant=Distill2026.01 | 41.4 | |
| Qwen2.5-7B-InstructModel Category=Open-source Models (7B), Parameter Count=7B, Model Variant=Instruct2026.01 | 39.9 | |
| LoGos(7B)Model Category=Open-source Models (7B), Parameter Count=7B2026.01 | 37.9 | |
| Qwen2.5-32B-BaseModel Category=Open-source Models (32B), Parameter Count=32B, Model Variant=Base2026.01 | 35.9 | |
| Qwen2.5-7B-BaseModel Category=Open-source Models (7B), Parameter Count=7B, Model Variant=Base2026.01 | 28.3 |