Physics Reasoning on Human-Adapted (Pedagogical)
61.4Accuracy (Textbooks)Claude-Opus-4.5
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Claude-Opus-4.5Model Category=Proprietary2026.04 | 61.4 | 63.1 | 55.7 | 62 | |
| Gemini-2.5-flashModel Category=Proprietary2026.04 | 59.2 | 63 | 59.1 | 61.4 | |
| OSS-20bModel Category=Open-Weight2026.04 | 42.5 | 46.7 | 44.3 | 45.1 | |
| Qwen3-4B-Thinking-2507Model Category=Open-Weight2026.04 | 18.9 | 24 | 15.7 | 20.5 | |
| Qwen3-4B-Instruct-2507Model Category=Open-Weight2026.04 | 10.2 | 13 | 5 | 11.5 | |
| DeepSeek-7BModel Category=Open-Weight2026.04 | 7.4 | 8.1 | 6.4 | 7.8 |