Scientific Reasoning on MMLU-Redux (ACC, TOK, LAT)
54.64AccuracyInftyThink+
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| InftyThink+RL Setting=Task reward only (✓ T), Sampling Temperature=0.7, Number of Samples=322026.02 | 54.64 | 4.81 | 30.42 | |
| InftyThink+RL Setting=Task and efficiency reward (✓ T+E), Sampling Temperature=0.7, Number of Samples=322026.02 | 53.94 | 2.29 | 12.55 | |
| InftyThink+RL Setting=Cold start only (✗), Sampling Temperature=0.7, Number of Samples=322026.02 | 51.34 | 3.12 | 17.61 | |
| VanillaRL Setting=Task reward only (✓ T), Sampling Temperature=0.7, Number of Samples=322026.02 | 51.1 | 5.85 | 69.27 | |
| VanillaRL Setting=Cold start only (✗), Sampling Temperature=0.7, Number of Samples=322026.02 | 50.37 | 3.45 | 28.54 |