Code Reasoning on MBPP base and extended (out-of-distribution)
55.83AccuracyInftyThink+
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| InftyThink+RL_Setting=Task reward only (✓ T), Sampling_Times=32, Temperature=0.72026.02 | 55.83 | 47.38 | 9.27 | 49.19 | |
| InftyThink+RL_Setting=Task and efficiency reward (✓ T+E), Sampling_Times=32, Temperature=0.72026.02 | 53.85 | 45.92 | 4.64 | 23.62 | |
| VanillaRL_Setting=Task reward only (✓ T), Sampling_Times=32, Temperature=0.72026.02 | 50.09 | 45.43 | 6.69 | 80.36 | |
| InftyThink+RL_Setting=Cold start only (✗), Sampling_Times=32, Temperature=0.72026.02 | 49.28 | 42.05 | 4.73 | 26.36 | |
| VanillaRL_Setting=Cold start only (✗), Sampling_Times=32, Temperature=0.72026.02 | 48.07 | 41.01 | 5.48 | 62.45 |