Math Word Problem Solving on ASDiv (pass@1 accuracy)
81.4Accuracy (pass@1)POLAR
Evaluation Results
| Method | Links | |
|---|---|---|
| POLARBackbone=LLaMA-3.2-3B-Instruct, Evaluation Protocol=pass@12026.06 | 81.4 | |
| Base (τ=0)Backbone=LLaMA-3.2-3B-Instruct, Temperature=0, Evaluation Protocol=pass@12026.06 | 78.4 | |
| DR.LLMBackbone=LLaMA-3.2-3B-Instruct, Evaluation Protocol=pass@12026.06 | 75.4 | |
| MindSkipBackbone=LLaMA-3.2-3B-Instruct, Evaluation Protocol=pass@12026.06 | 9 | |
| FlexiDepthBackbone=LLaMA-3.2-3B-Instruct, Evaluation Protocol=pass@12026.06 | 4.7 | |
| ShortGPTBackbone=LLaMA-3.2-3B-Instruct, Evaluation Protocol=pass@12026.06 | 2.3 |