Mathematical Reasoning on SVAMP (Accuracy, Reusability, Verifiability)
95AccuracyDeepSeek-R1
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DeepSeek-R12026.02 | 95 | 34 | 80 | |
| Gemma32026.02 | 93 | 39 | 79 | |
| Phi4-Reasoning2026.02 | 90 | 44 | 89 | |
| Llama3.12026.02 | 82 | 65 | 72 |
Loading the SOTA2 catalog…