Physics Reasoning on QFT Synthetic Hard
44.5AccuracyClaude-Opus-4.5
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Claude-Opus-4.5Model Type=Proprietary2026.04 | 44.5 | 62.5 | |
| Gemini-2.5-flashModel Type=Proprietary2026.04 | 30.2 | 57.5 | |
| OSS-20bModel Type=Open-Weight2026.04 | 22.2 | 53.8 | |
| Qwen3-4B-Thinking-2507Model Type=Open-Weight2026.04 | 3.2 | 7.5 | |
| Qwen3-4B-Instruct-2507Model Type=Open-Weight2026.04 | 2.5 | 6.2 | |
| DeepSeek-R1-Distill-Qwen-7BModel Type=Open-Weight2026.04 | 0 | 0 |