Out-of-Domain Reasoning on BGQA, CRUX Eval, Strategy QA, and Table Bench
71.1BGQA AccuracyQwQ-32B-Preview
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| QwQ-32B-Previewmode=zero-shot, decoding=greedy2026.05 | 71.1 | 65.2 | 88.2 | 51.5 | 69 | |
| OpenMath2-Llama3.1-70Bmode=zero-shot, decoding=greedy2026.05 | 68.7 | 35.1 | 95.6 | 46.8 | — | |
| STRIDE-Qwen-7Bmode=zero-shot, decoding=greedy2026.05 | 66.8 | 57 | 92 | 43.8 | 64.9 | |
| Llama-3.1-70B-Instructmode=zero-shot, decoding=greedy2026.05 | 58.3 | 59.6 | 88.8 | 34.2 | — | |
| Qwen2.5-7B-Instructmode=zero-shot, decoding=greedy2026.05 | 53 | 58.1 | 91.3 | 43.2 | 61.4 | |
| Qwen2.5-Math-7B-Instructmode=zero-shot, decoding=greedy2026.05 | 51.3 | 28 | 85.3 | 36.2 | 50.2 | |
| Llama-3.1-8B-Instructmode=zero-shot, decoding=greedy2026.05 | 50.3 | 38.5 | 92.2 | 32.4 | 53.4 | |
| STRIDE-Llama-8Bmode=zero-shot, decoding=greedy2026.05 | 50.2 | 46 | 88.2 | 32.3 | 54.2 | |
| OpenMath2-Llama3.1-8Bmode=zero-shot, decoding=greedy2026.05 | 49 | 11.1 | 84.4 | 34.2 | 44.7 |