Mathematical Reasoning on GSM8K (Spd, tau)
7.46SpdGOOSE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GOOSEModel=Llama-3-8B, GPU=NVIDIA A402026.04 | 7.46 | 9.25 | |
| PLDModel=Llama-3-8B, GPU=NVIDIA A402026.04 | 4.04 | 4.18 | |
| TRModel=Llama-3-8B, GPU=NVIDIA A402026.04 | 3.68 | 4.52 | |
| GOOSEModel=Qwen2-8B, GPU=NVIDIA A402026.04 | 3.23 | 3.87 | |
| EAGLE-2Model=Vicuna-13B, GPU=NVIDIA A402026.04 | 3.18 | 4.98 | |
| EAGLE-2Model=Llama-3-8B, GPU=NVIDIA A402026.04 | 2.75 | 5.52 | |
| EAGLE-2Model=Vicuna-7B, GPU=NVIDIA A402026.04 | 2.73 | 4.51 | |
| GOOSEModel=Vicuna-7B, GPU=NVIDIA A402026.04 | 2.67 | 3.23 | |
| GOOSEModel=Vicuna-13B, GPU=NVIDIA A402026.04 | 2.66 | 3.14 | |
| TRModel=Qwen2-8B, GPU=NVIDIA A402026.04 | 2.6 | 3.03 | |
| LookaheadModel=Llama-3-8B, GPU=NVIDIA A402026.04 | 2.59 | 2.8 | |
| TRModel=Vicuna-13B, GPU=NVIDIA A402026.04 | 2.56 | 3.02 | |
| GOOSEModel=Vicuna-33B, GPU=NVIDIA A1002026.04 | 2.53 | 3.1 | |
| TRModel=Vicuna-7B, GPU=NVIDIA A402026.04 | 2.46 | 2.96 | |
| TRModel=Vicuna-33B, GPU=NVIDIA A1002026.04 | 2.14 | 2.63 | |
| LookaheadModel=Qwen2-8B, GPU=NVIDIA A402026.04 | 1.93 | 1.88 | |
| PLDModel=Qwen2-8B, GPU=NVIDIA A402026.04 | 1.65 | 1.71 | |
| LookaheadModel=Vicuna-7B, GPU=NVIDIA A402026.04 | 1.63 | 1.67 | |
| LookaheadModel=Vicuna-13B, GPU=NVIDIA A402026.04 | 1.58 | 1.62 | |
| LookaheadModel=Vicuna-33B, GPU=NVIDIA A1002026.04 | 1.49 | 1.55 | |
| PLDModel=Vicuna-7B, GPU=NVIDIA A402026.04 | 1.43 | 1.46 | |
| PLDModel=Vicuna-13B, GPU=NVIDIA A402026.04 | 1.33 | 1.36 | |
| PLDModel=Vicuna-33B, GPU=NVIDIA A1002026.04 | 1.29 | 1.33 | |
| RESTModel=Qwen2-8B, GPU=NVIDIA A402026.04 | 1.21 | 1.16 | |
| RESTModel=Vicuna-13B, GPU=NVIDIA A402026.04 | 1.18 | 1.21 | |
| RESTModel=Vicuna-7B, GPU=NVIDIA A402026.04 | 1.17 | 1.19 | |
| RESTModel=Vicuna-33B, GPU=NVIDIA A1002026.04 | 1.14 | 1.18 | |
| RESTModel=Llama-3-8B, GPU=NVIDIA A402026.04 | 1.06 | 1.07 | |
| ARModel=Vicuna-7B, GPU=NVIDIA A402026.04 | 1 | 1 | |
| ARModel=Llama-3-8B, GPU=NVIDIA A402026.04 | 1 | 1 | |
| ARModel=Qwen2-8B, GPU=NVIDIA A402026.04 | 1 | 1 | |
| ARModel=Vicuna-13B, GPU=NVIDIA A402026.04 | 1 | 1 | |
| ARModel=Vicuna-33B, GPU=NVIDIA A1002026.04 | 1 | 1 |