Mathematical Reasoning on MATH (Sampling Metrics t1/t3/t5)
39.7M1 Score @ t1Self-Refine
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Self-RefineBackbone=GPT-3.52024.07 | 39.7 | 46.5 | — | — | 36.5 | 46.7 | |
| Eurus-7B-SFTBackbone=Eurus-7B2024.07 | 12.3 | 19.8 | 16.3 | 22.9 | — | — | |
| Self-RefineBackbone=Eurus-7B-SFT2024.07 | 12.3 | 19.4 | — | — | 9 | 15.1 | |
| RISEBackbone=Mistral-7B2024.07 | 7.5 | 13 | 8.4 | 13 | — | — | |
| Self-RefineBackbone=Mistral-7B2024.07 | 7.5 | 12.3 | — | — | 7.1 | 11.4 | |
| RISEBackbone=Mistral-7B, Iteration=12024.07 | 6.7 | 9.5 | 18.4 | 29.7 | — | — | |
| RISEBackbone=Llama2 Base, Iteration=12024.07 | 6.3 | 8.8 | 9.7 | 19.4 | — | — | |
| RISEBackbone=Llama2 Base, Iteration=22024.07 | 5.8 | 10.4 | 10.4 | 19.8 | — | — | |
| SFT on oracle dataBackbone=Llama2 Base, Data=Only correct data2024.07 | 5.8 | 7.9 | 5.5 | 12.1 | — | — | |
| Self-RefineBackbone=Llama2 Base, Iteration=22024.07 | 5.8 | 9.4 | — | — | 5.7 | 9.5 | |
| RISEBackbone=Llama2 Base, Stage=Boost2024.07 | 5.5 | 6.8 | 5.5 | 14.6 | — | — | |
| SFT on oracle dataBackbone=Llama2 Base, Data=Correct and incorrect2024.07 | 5 | 5.2 | 5 | 13.1 | — | — | |
| RISEBackbone=Llama2 Base2024.07 | 1.9 | 5.1 | 1.4 | 2.3 | — | — | |
| Self-RefineBackbone=Llama2 Base2024.07 | 1.9 | 5.1 | — | — | 1.9 | 3.1 |