Machine Translation on WMT-23
2.81SpeedupSpecBlock+adapt
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SpecBlock+adaptModel=Llama-3.1-8B, Temperature=02026.05 | 2.81 | 3.81 | 15 | |
| SpecBlock+OSDModel=Llama-3.1-8B, Temperature=02026.05 | 2.8 | 3.85 | 18 | |
| SpecBlockModel=Llama-3.1-8B, Temperature=02026.05 | 2.79 | 3.75 | 16 | |
| SpecBlock+OSDModel=Llama-3.1-8B, Temperature=1.02026.05 | 2.36 | 3.59 | 17 | |
| SpecBlock+adaptModel=Llama-3.1-8B, Temperature=1.02026.05 | 2.36 | 3.57 | 15 | |
| SpecBlock+adaptModel=Qwen3-8B, Temperature=02026.05 | 2.34 | 3.36 | 17 | |
| SpecBlock+OSDModel=Qwen3-8B, Temperature=02026.05 | 2.32 | 3.37 | 19 | |
| SpecBlockModel=Llama-3.1-8B, Temperature=1.02026.05 | 2.31 | 3.41 | 14 | |
| SpecBlockModel=Qwen3-8B, Temperature=02026.05 | 2.3 | 3.28 | 14 | |
| EAGLE-3Model=Llama-3.1-8B, Temperature=02026.05 | 2.28 | 4.6 | 31 | |
| SpecBlock+OSDModel=Qwen3-32B, Temperature=02026.05 | 2.24 | 3.24 | 15 | |
| SpecBlock+adaptModel=Qwen3-32B, Temperature=02026.05 | 2.24 | 3.22 | 13 | |
| SpecBlockModel=Qwen3-32B, Temperature=02026.05 | 2.2 | 3.15 | 11 | |
| SpecBlock+adaptModel=Qwen3-8B, Temperature=1.02026.05 | 2.19 | 3.31 | 18 | |
| SpecBlock+OSDModel=Qwen3-8B, Temperature=1.02026.05 | 2.16 | 3.34 | 19 | |
| SpecBlock+adaptModel=Qwen3-32B, Temperature=1.02026.05 | 2.14 | 3.22 | 13 | |
| SpecBlockModel=Qwen3-8B, Temperature=1.02026.05 | 2.11 | 3.19 | 14 | |
| SpecBlock+OSDModel=Qwen3-32B, Temperature=1.02026.05 | 2.1 | 3.23 | 14 | |
| SpecBlockModel=Qwen3-32B, Temperature=1.02026.05 | 2.07 | 3.1 | 11 | |
| FalconModel=Llama-3.1-8B, Temperature=02026.05 | 1.9 | 3.33 | 26 | |
| EAGLE-3Model=Qwen3-8B, Temperature=02026.05 | 1.81 | 3.12 | 29 | |
| EAGLE-3Model=Llama-3.1-8B, Temperature=1.02026.05 | 1.81 | 3.94 | 30 | |
| EAGLE-3Model=Qwen3-32B, Temperature=02026.05 | 1.71 | 2.96 | 24 | |
| ParallelSpecModel=Llama-3.1-8B, Temperature=02026.05 | 1.66 | 2.3 | 8 | |
| EAGLE-3Model=Qwen3-8B, Temperature=1.02026.05 | 1.65 | 3.1 | 29 | |
| EAGLE-3Model=Qwen3-32B, Temperature=1.02026.05 | 1.55 | 2.95 | 25 | |
| FalconModel=Llama-3.1-8B, Temperature=1.02026.05 | 1.51 | 2.83 | 27 | |
| MedusaModel=Llama-3.1-8B, Temperature=02026.05 | 1.34 | 2.05 | 6 | |
| ParallelSpecModel=Llama-3.1-8B, Temperature=1.02026.05 | 1.33 | 1.84 | 9 | |
| MedusaModel=Llama-3.1-8B, Temperature=1.02026.05 | 1.1 | 1.63 | 7 | |
| SpSModel=Llama-3.1-8B, Temperature=02026.05 | 0.99 | 1.92 | 38 | |
| SpSModel=Llama-3.1-8B, Temperature=1.02026.05 | 0.82 | 1.56 | 40 |