Code Reasoning on HumanEval base and extended (out-of-distribution)
0.677AccuracyInftyThink+
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| InftyThink+RL_Setting=Task reward only (✓ T), Sampling_Times=32, Temperature=0.72026.02 | 0.677 | 0.626 | 8.21 | 42.22 | |
| InftyThink+RL_Setting=Task and efficiency reward (✓ T+E), Sampling_Times=32, Temperature=0.72026.02 | 0.6742 | 0.6191 | 4.66 | 23.9 | |
| VanillaRL_Setting=Task reward only (✓ T), Sampling_Times=32, Temperature=0.72026.02 | 0.6044 | 0.5627 | 8.17 | 90.1 | |
| InftyThink+RL_Setting=Cold start only (✗), Sampling_Times=32, Temperature=0.72026.02 | 0.5903 | 0.5434 | 5.02 | 27.5 | |
| VanillaRL_Setting=Cold start only (✗), Sampling_Times=32, Temperature=0.72026.02 | 0.5703 | 0.5252 | 6.58 | 65.89 |