Arithmetic Reasoning on GSM8K numeric-remapping (attack set)
87.84AccuracyGPT-OSS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GPT-OSSParameters=120B2026.06 | 87.84 | 12.16 | 8.07 | |
| DeepSeek-R1Parameters=70B2026.06 | 80.6 | 19.4 | 185.89 | |
| Gemma4Parameters=31B2026.06 | 74.18 | 25.82 | 58.59 |