Math Tutoring on OpenLearnLM OOD
8.08CKGPT-5.2 (Ped.)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GPT-5.2 (Ped.)enables thinking (Th.)=true, prompt seed type=Ped.2026.05 | 8.08 | 8.46 | 8.63 | 8.68 | 8.46 | |
| Ped. Think R (RL)enables thinking (Th.)=true, applies thinking reward (Th.R)=true, prompt seed type=Ped.2026.05 | 7.99 | 7.43 | 7.77 | 7.86 | 7.76 | |
| NoThink (RL)enables thinking (Th.)=false, applies thinking reward (Th.R)=false, prompt seed type=Gen.2026.05 | 7.95 | 7.43 | 7.77 | 7.57 | 7.68 | |
| Think NR (RL)enables thinking (Th.)=true, applies thinking reward (Th.R)=false, prompt seed type=Gen.2026.05 | 7.95 | 7.43 | 7.76 | 7.79 | 7.73 | |
| Think R (RL)enables thinking (Th.)=true, applies thinking reward (Th.R)=true, prompt seed type=Gen.2026.05 | 7.95 | 7.43 | 7.76 | 7.71 | 7.71 | |
| Ped. Think NR (RL)enables thinking (Th.)=true, applies thinking reward (Th.R)=false, prompt seed type=Ped.2026.05 | 7.95 | 7.43 | 7.76 | 7.79 | 7.73 | |
| EvoPromptenables thinking (Th.)=true, applies thinking reward (Th.R)=true, prompt seed type=Gen.2026.05 | 7.62 | 7.54 | 8.69 | 8.5 | 8.09 | |
| No optimizationenables thinking (Th.)=false, applies thinking reward (Th.R)=false, prompt seed type=Gen.2026.05 | 7.56 | 6.87 | 8.53 | 7.93 | 7.72 | |
| DeepSeek-V3.2 (Ped.)enables thinking (Th.)=true, prompt seed type=Ped.2026.05 | 7.46 | 7.32 | 8.63 | 8.77 | 8.05 | |
| ACEenables thinking (Th.)=true, applies thinking reward (Th.R)=false, prompt seed type=Ped.2026.05 | 7.11 | 6.63 | 8.62 | 8.57 | 7.73 | |
| MIPROv2enables thinking (Th.)=true, applies thinking reward (Th.R)=true, prompt seed type=Gen.2026.05 | 6.97 | 7.42 | 8.56 | 8.21 | 7.79 | |
| TextGradenables thinking (Th.)=true, applies thinking reward (Th.R)=false, prompt seed type=Ped.2026.05 | 6.97 | 6.67 | 7.45 | 8.36 | 7.36 | |
| LeakShieldenables thinking (Th.)=true, applies thinking reward (Th.R)=false, prompt seed type=Gen.2026.05 | 6.97 | 6.87 | 7.12 | 8 | 7.24 | |
| Frameenables thinking (Th.)=true, applies thinking reward (Th.R)=false, prompt seed type=Ped.2026.05 | 6.97 | 6.83 | 7.62 | 7.93 | 7.34 | |
| ParetoGradenables thinking (Th.)=true, applies thinking reward (Th.R)=false, prompt seed type=Gen.2026.05 | 6.92 | 6.55 | 7.99 | 8.07 | 7.38 | |
| CondBridgeenables thinking (Th.)=true, applies thinking reward (Th.R)=true, prompt seed type=Gen.2026.05 | 6.88 | 6.71 | 7.91 | 8.14 | 7.41 | |
| MetaBlendenables thinking (Th.)=true, applies thinking reward (Th.R)=true, prompt seed type=Gen.2026.05 | 6.88 | 6.79 | 7.68 | 8.29 | 7.41 | |
| TF-GRPOenables thinking (Th.)=true, applies thinking reward (Th.R)=true, prompt seed type=Gen.2026.05 | 6.78 | 6.71 | 7.95 | 8.5 | 7.49 | |
| OPROenables thinking (Th.)=true, applies thinking reward (Th.R)=true, prompt seed type=Ped.2026.05 | 6.64 | 6.67 | 7.7 | 8.21 | 7.31 | |
| Claude-4-Opus (Ped.)enables thinking (Th.)=true, prompt seed type=Ped.2026.05 | 6.63 | 8.61 | 8.82 | 8.45 | 8.13 | |
| GEPAenables thinking (Th.)=true, applies thinking reward (Th.R)=false, prompt seed type=Gen.2026.05 | 6.41 | 6.87 | 7.27 | 8.43 | 7.24 |