Mathematical Reasoning on MultiArith (Punctuation Robustness)
99.44Accuracy (Clean)Llama3.1
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Llama3.12025.01 | 99.44 | 94.44 | 91.66 | 83.88 | 9.67 | |
| Qwen2.52025.01 | 97.22 | 94.44 | 85.55 | 83.88 | 11.04 | |
| Mathstral2025.01 | 96.11 | 92.77 | 86.11 | 87.22 | 9.47 | |
| Llama32025.01 | 95 | 92.77 | 91.66 | 88.33 | 7.79 | |
| DeepSeek2025.01 | 93.88 | 90 | 92.77 | 88.88 | 8.28 | |
| Gemma22025.01 | 89.44 | 82.77 | 78.88 | 72.22 | 19.45 | |
| Mistral2025.01 | 73.88 | 72.77 | 71.11 | 65.55 | 23.66 | |
| Zephyr2025.01 | 37.22 | 22.22 | 16.11 | 12.77 | 77.1 |