Arithmetic Reasoning on MAWPS numeric-remapping attack
98.81AccuracyGPT-OSS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GPT-OSSParameters=120B2026.06 | 98.81 | 1.19 | 8.12 | |
| Gemma4Parameters=31B2026.06 | 98.25 | 1.75 | 32.55 | |
| DeepSeek-R1Parameters=70B2026.06 | 96.62 | 3.38 | 146.06 |
Loading the SOTA2 catalog…