Mathematical Reasoning on TheoremQA (Pass@1, Pass@100)
24.7Pass@1LaDiR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LaDiRBackbone=LLAMA 3.1 8B2025.10 | 24.7 | 30.7 | |
| TaH+Backbone=LLAMA 3.1 8B2025.10 | 24.5 | 28.4 | |
| Soft ThinkBackbone=LLAMA 3.1 8B2025.10 | 22.2 | 24.7 | |
| SFTBackbone=LLAMA 3.1 8B, Decoding temperature (alpha)=0.12025.10 | 22 | 22.8 | |
| CoT SFTBackbone=LLADA 8B2025.10 | 20.9 | 26.3 | |
| SFTBackbone=LLAMA 3.1 8B, Decoding temperature (alpha)=0.72025.10 | 20.9 | 24.6 | |
| SFTBackbone=LLAMA 3.1 8B, Decoding temperature (alpha)=12025.10 | 20.3 | 26 | |
| Discrete LatentBackbone=LLAMA 3.1 8B2025.10 | 20.3 | 28.5 | |
| SFTBackbone=LLAMA 3.1 8B, Decoding temperature (alpha)=1.22025.10 | 19.5 | 27.5 | |
| Sol-Only SFTBackbone=LLAMA 3.1 8B2025.10 | 16.9 | 22.2 | |
| Base ModelBackbone=LLADA 8B2025.10 | 16.6 | 21.6 | |
| LaDiR –w/o Stage 2Backbone=LLAMA 3.1 8B, Training Stage=without Stage 22025.10 | 11.9 | 16.9 | |
| iCoTBackbone=LLAMA 3.1 8B2025.10 | 11.5 | 14 | |
| CoconutBackbone=LLAMA 3.1 8B2025.10 | 11.4 | 14.9 | |
| PLANNERBackbone=LLAMA 3.1 8B2025.10 | 10.3 | 17.3 | |
| LD4LGBackbone=LLAMA 3.1 8B2025.10 | 9.6 | 15.7 | |
| CODIBackbone=LLAMA 3.1 8B2025.10 | 8.8 | 15.7 | |
| Pause TokenBackbone=LLAMA 3.1 8B2025.10 | 8.3 | 12.9 |