Speculative Decoding on Mean (MT-Bench, HumanEval, GSM8K)
4.83Mean Acceptance Length (tau)MTP Lλ LK
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MTP Lλ LKTarget Model=DeepSeek-V3-0324 (685B), Temperature=02026.02 | 4.83 | 0.8 | |
| EAGLE-3 Lλ LKTarget Model=LLaMA 3.3 70B Instruct, Temperature=02026.02 | 4.81 | 0.5 | |
| MTP KLTarget Model=DeepSeek-V3-0324 (685B), Temperature=02026.02 | 4.79 | — | |
| EAGLE-3 KLTarget Model=LLaMA 3.3 70B Instruct, Temperature=02026.02 | 4.78 | — | |
| MTP Lλ LKTarget Model=DeepSeek-V3-0324 (685B), Temperature=12026.02 | 4.68 | 5.6 | |
| EAGLE-3 Lλ LKTarget Model=LLaMA 3.3 70B Instruct, Temperature=12026.02 | 4.66 | 3.5 | |
| EAGLE-3 KLTarget Model=LLaMA 3.3 70B Instruct, Temperature=12026.02 | 4.5 | — | |
| EAGLE-3 Lλ LKTarget Model=LLaMA 3.1 8B Instruct, Temperature=02026.02 | 4.43 | 1.6 | |
| MTP KLTarget Model=DeepSeek-V3-0324 (685B), Temperature=12026.02 | 4.43 | — | |
| EAGLE-3 KLTarget Model=LLaMA 3.1 8B Instruct, Temperature=02026.02 | 4.36 | — | |
| EAGLE-3 Lλ LKTarget Model=Qwen3-235B-A22B-Instruct-2507, Temperature=02026.02 | 4.32 | 1.8 | |
| EAGLE-3 KLTarget Model=Qwen3-235B-A22B-Instruct-2507, Temperature=02026.02 | 4.25 | — | |
| EAGLE-3 Lλ LKTarget Model=Qwen3-235B-A22B-Instruct-2507, Temperature=12026.02 | 4.08 | 8.2 | |
| EAGLE-3 Lλ LKTarget Model=LLaMA 3.1 8B Instruct, Temperature=12026.02 | 4.01 | 3.9 | |
| EAGLE-3 KLTarget Model=LLaMA 3.1 8B Instruct, Temperature=12026.02 | 3.86 | — | |
| EAGLE-3 KLTarget Model=Qwen3-235B-A22B-Instruct-2507, Temperature=12026.02 | 3.77 | — | |
| EAGLE-3 Lλ LKTarget Model=GPT-OSS 20B, Temperature=02026.02 | 3.49 | 0.9 | |
| EAGLE-3 KLTarget Model=GPT-OSS 20B, Temperature=02026.02 | 3.46 | — | |
| EAGLE-3 Lλ LKTarget Model=GPT-OSS 20B, Temperature=12026.02 | 3.29 | 3.8 | |
| MTP originalTarget Model=DeepSeek-V3-0324 (685B), Temperature=02026.02 | 3.2 | — | |
| EAGLE-3 KLTarget Model=GPT-OSS 20B, Temperature=12026.02 | 3.17 | — | |
| MTP originalTarget Model=DeepSeek-V3-0324 (685B), Temperature=12026.02 | 3.09 | — | |
| EAGLE-3 Lλ LKTarget Model=GPT-OSS 120B, Temperature=02026.02 | 2.81 | 1.8 | |
| EAGLE-3 KLTarget Model=GPT-OSS 120B, Temperature=02026.02 | 2.76 | — | |
| EAGLE-3 Lλ LKTarget Model=GPT-OSS 120B, Temperature=12026.02 | 2.65 | 7.7 | |
| EAGLE-3 KLTarget Model=GPT-OSS 120B, Temperature=12026.02 | 2.46 | — |