Math Reasoning on GAM-hard
12.3AccCoT-SFT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CoT-SFTReasoning Type=CoT, Training=SFT2026.01 | 12.3 | 35.6 | |
| ATP-LatentReasoning Type=Latent, Training=RL2026.01 | 9.8 | 10 | |
| ATP-Latent w Only Coherence as RewardReasoning Type=Latent, Training=RL, Reward Mechanism=Unsupervised Coherence2026.01 | 9.5 | 9.7 | |
| SIM-CoT*Reasoning Type=Latent, Source=Reported in Wei et al. (2025)2026.01 | 9.3 | — | |
| ATP-Latent -w/o RL (Ours-SFT)Reasoning Type=Latent, Training=SFT2026.01 | 9.3 | 9.7 | |
| ATP-Latent -w/o VAEReasoning Type=Latent, Training=RL, VAE=Excluded2026.01 | 9.2 | 10.1 | |
| ATP-Latent -w/o Stop HeadReasoning Type=Latent, Training=RL, Stop Head=Excluded2026.01 | 8.8 | 9.8 | |
| SIM-CoTReasoning Type=Latent2026.01 | 8.6 | 9.8 | |
| CoconutReasoning Type=Latent2026.01 | 8.2 | 9.8 | |
| Coconut*Reasoning Type=Latent, Source=Reported in Wei et al. (2025)2026.01 | 8.1 | — | |
| Answer-SFTReasoning Type=Answer-only, Training=SFT2026.01 | 6.4 | 4.8 | |
| CoLaRReasoning Type=Latent2026.01 | 5.7 | 11.5 | |
| iCoT*Reasoning Type=Latent, Source=Reported in Wei et al. (2025)2026.01 | 5.7 | — |