Mathematical Reasoning on MATH 8B Instruct (test)
23AccuracyProb Margin + Both
Evaluation results
| Method | Links | |
|---|---|---|
| Prob Margin + BothToken Selection (T.S.)=-, Position Selection (P.S.)=L&E, Randomness Step=all, Compute Budget (T)=322026.04 | 23 | |
| Top1 Prob + BothToken Selection (T.S.)=-, Position Selection (P.S.)=L&E, Randomness Step=all, Compute Budget (T)=322026.04 | 22.8 | |
| Top1 Prob + PlannerToken Selection (T.S.)=-, Position Selection (P.S.)=L, Randomness Step=1st, Compute Budget (T)=322026.04 | 22.4 | |
| Top1 Prob + EOS Temp.Token Selection (T.S.)=-, Position Selection (P.S.)=E, Randomness Step=all, Compute Budget (T)=322026.04 | 22.4 | |
| Prob MarginToken Selection (T.S.)=-, Position Selection (P.S.)=-, Randomness Step=-, Compute Budget (T)=322026.04 | 19.6 | |
| Temperature SamplingToken Selection (T.S.)=T, Position Selection (P.S.)=-, Randomness Step=all, Compute Budget (T)=322026.04 | 19.4 | |
| Top1 ProbToken Selection (T.S.)=-, Position Selection (P.S.)=-, Randomness Step=-, Compute Budget (T)=322026.04 | 19.2 | |
| Init. PositionToken Selection (T.S.)=-, Position Selection (P.S.)=U, Randomness Step=1st, Compute Budget (T)=322026.04 | 17.6 | |
| Ancestral SamplingToken Selection (T.S.)=-, Position Selection (P.S.)=U, Randomness Step=all, Compute Budget (T)=322026.04 | 13.2 |