Mathematical Reasoning on College Olymp.
36.29Pass@1OpenSIR
Evaluation Results
| Method | Links | |
|---|---|---|
| OpenSIRBackbone=Llama-3.1-8B-Instruct2025.11 | 36.29 | |
| OpenSIRBackbone=Llama-3.2-3B-Instruct2025.11 | 35.42 | |
| GRPOgsm8kBackbone=Llama-3.1-8B-Instruct2025.11 | 35.03 | |
| GRPOmathBackbone=Llama-3.1-8B-Instruct2025.11 | 34.93 | |
| Absolute ZeroBackbone=Llama-3.1-8B-Instruct2025.11 | 34.39 | |
| BaseBackbone=Llama-3.1-8B-Instruct2025.11 | 34.1 | |
| GRPOgsm8kBackbone=Llama-3.2-3B-Instruct2025.11 | 33.33 | |
| GRPOmathBackbone=Llama-3.2-3B-Instruct2025.11 | 32.95 | |
| R-ZeroBackbone=Llama-3.1-8B-Instruct2025.11 | 32.93 | |
| R-ZeroBackbone=Llama-3.2-3B-Instruct2025.11 | 32.72 | |
| Absolute ZeroBackbone=Llama-3.2-3B-Instruct2025.11 | 31.93 | |
| BaseBackbone=Llama-3.2-3B-Instruct2025.11 | 28.78 |