Mathematical Reasoning on GSM8K (Accuracy, Inference Count, Token Count)
0.683AccuracySEAG
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SEAGModel=Llama3-8B-Base2025.01 | 0.683 | 64.84 | 25,853.65 | 1,263.95 | |
| SEModel=Llama3-8B-Base2025.01 | 0.675 | 92.89 | 42,832.03 | 1,969.56 | |
| RAPModel=Llama3-8B-Base2025.01 | 0.665 | 146.18 | 67,526.58 | 3,113.34 | |
| CoT-SCModel=Llama3-8B-Base2025.01 | 0.598 | 10 | 2,183.76 | 906.97 | |
| ToTModel=Llama3-8B-Base2025.01 | 0.598 | 121.93 | 57,187.68 | 2,856.04 | |
| CoTModel=Llama3-8B-Base2025.01 | 0.445 | 1 | 218.37 | 85.26 |