Mathematical Reasoning on AIME In-Distribution
56.6Initial F1 ScoreAutoPyVerifier
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AutoPyVerifierVerifier Model=GPT-5.4 mini2026.04 | 56.6 | 73.8 | 17.2 | |
| AutoPyVerifierVerifier Model=Gemini-3.1 Pro2026.04 | 46.7 | 62.5 | 15.8 | |
| AutoPyVerifierVerifier Model=GPT-5.42026.04 | 38.8 | 80.1 | 41.3 | |
| AutoPyVerifierVerifier Model=Gemini-3.1 Fl2026.04 | 38.8 | 51.5 | 12.7 | |
| AutoPyVerifierVerifier Model=Claude Hai-4.52026.04 | 38.8 | 73.1 | 34.3 |