Dialogue Evaluation on MT-Bench (τ and Speedup)
4.01Kendall's Tau (τ)EAGLE-3
Evaluation results
| Method | Links | ||
|---|---|---|---|
| EAGLE-3Model=LLaMA 3.3 70B Instruct, Type=Ours, Setup=KL, Temperature=02026.02 | 4.01 | 3.01 | |
| EAGLE-3Model=LLaMA 3.3 70B Instruct, Type=Ours, Setup=L_lambda_LK, η = 3, Temperature=02026.02 | 4 | 2.98 | |
| MTPModel=DeepSeek V3 0324, Type=Ours, Setup=L_lambda_LK, Temperature=02026.02 | 4 | 2.22 | |
| MTPModel=DeepSeek V3 0324, Type=Ours, Setup=KL, Temperature=02026.02 | 3.96 | 2.22 | |
| EAGLE-3Model=LLaMA 3.3 70B Instruct, Type=Ours, Setup=L_alpha_LK, Temperature=02026.02 | 3.95 | 3 | |
| EAGLE-3Model=LLaMA 3.3 70B Instruct, Type=Ours, Setup=L_lambda_LK, η = 3, Temperature=12026.02 | 3.89 | 2.89 | |
| MTPModel=DeepSeek V3 0324, Type=Ours, Setup=L_lambda_LK, Temperature=12026.02 | 3.88 | 2.14 | |
| EAGLE-3Model=LLaMA 3.1 8B Instruct, Type=Ours, Setup=L_lambda_LK, η = 3, Temperature=02026.02 | 3.84 | 2.62 | |
| EAGLE-3Model=LLaMA 3.1 8B Instruct, Type=Ours, Setup=L_lambda_LK, η = 1, Temperature=02026.02 | 3.8 | 2.64 | |
| EAGLE-3Model=LLaMA 3.1 8B Instruct, Type=Ours, Setup=L_lambda_LK, η = 0.7, Temperature=02026.02 | 3.79 | 2.61 | |
| EAGLE-3Model=LLaMA 3.1 8B Instruct, Type=Ours, Setup=L_lambda_LK, λ = 0.5, Temperature=02026.02 | 3.78 | 2.63 | |
| EAGLE-3Model=LLaMA 3.1 8B Instruct, Type=Ours, Setup=L_alpha_LK, Temperature=02026.02 | 3.77 | 2.61 | |
| EAGLE-3Model=LLaMA 3.3 70B Instruct, Type=Ours, Setup=KL, Temperature=12026.02 | 3.76 | 2.82 | |
| EAGLE-3Model=LLaMA 3.3 70B Instruct, Type=Ours, Setup=L_alpha_LK, Temperature=12026.02 | 3.76 | 2.85 | |
| EAGLE-3Model=LLaMA 3.1 8B Instruct, Type=Ours, Setup=KL, Temperature=02026.02 | 3.75 | 2.6 | |
| DSparktarget_model=Qwen3-8B2026.07 | 3.72 | — | |
| DSparktarget_model=Qwen3-14B2026.07 | 3.7 | — | |
| EAGLE-3Model=LLaMA 3.1 8B Instruct, Type=Ours, Setup=L_lambda_LK, η = 10, Temperature=02026.02 | 3.67 | 2.53 | |
| MTPModel=DeepSeek V3 0324, Type=Ours, Setup=KL, Temperature=12026.02 | 3.66 | 1.85 | |
| DSparktarget_model=Qwen3-4B2026.07 | 3.64 | — | |
| ZK-8BModel=LLaMA 3.1 8B Instruct, Type=HF, Temperature=02026.02 | 3.54 | 2.45 | |
| EAGLE-3Model=LLaMA 3.1 8B Instruct, Type=Ours, Setup=L_lambda_LK, η = 0.7, Temperature=12026.02 | 3.53 | 2.37 | |
| EAGLE-3Model=LLaMA 3.1 8B Instruct, Type=Ours, Setup=L_lambda_LK, η = 1, Temperature=12026.02 | 3.51 | 2.3 | |
| EAGLE-3Model=LLaMA 3.1 8B Instruct, Type=Ours, Setup=L_alpha_LK, Temperature=12026.02 | 3.5 | 2.3 | |
| DSparktarget_model=Gemma4-12B2026.07 | 3.49 | — | |
| EAGLE-3Model=LLaMA 3.1 8B Instruct, Type=Ours, Setup=L_lambda_LK, η = 3, Temperature=12026.02 | 3.48 | 2.39 | |
| YH-8BModel=LLaMA 3.1 8B Instruct, Type=HF, Temperature=02026.02 | 3.44 | 2.42 | |
| EAGLE-3Model=LLaMA 3.1 8B Instruct, Type=Ours, Setup=KL, Temperature=12026.02 | 3.39 | 2.29 | |
| EAGLE-3Model=Qwen 3 235B A22B Instruct, Type=Ours, Setup=L_lambda_LK, η = 3, Temperature=02026.02 | 3.36 | 2.13 | |
| EAGLE-3Model=LLaMA 3.1 8B Instruct, Type=Ours, Setup=L_lambda_LK, λ = 0.5, Temperature=12026.02 | 3.35 | 2.36 | |
| EAGLE-3Model=GPT-OSS 20B, Type=Ours, Setup=L_lambda_LK, η = 3, Temperature=02026.02 | 3.35 | 1.42 | |
| EAGLE-3Model=LLaMA 3.1 8B Instruct, Type=Ours, Setup=L_lambda_LK, η = 10, Temperature=12026.02 | 3.34 | 2.3 | |
| EAGLE-3Model=Qwen 3 235B A22B Instruct, Type=Ours, Setup=KL, Temperature=02026.02 | 3.33 | 2.09 | |
| EAGLE-3Model=GPT-OSS 20B, Type=Ours, Setup=KL, Temperature=02026.02 | 3.31 | 1.41 | |
| EAGLE-3Model=Qwen 3 235B A22B Instruct, Type=Ours, Setup=L_alpha_LK, Temperature=02026.02 | 3.29 | 2.1 | |
| EAGLE-3Model=GPT-OSS 20B, Type=Ours, Setup=L_alpha_LK, Temperature=12026.02 | 3.28 | 1.35 | |
| EAGLE-3Model=GPT-OSS 20B, Type=Ours, Setup=L_alpha_LK, Temperature=02026.02 | 3.27 | 1.41 | |
| EAGLE-3Model=GPT-OSS 20B, Type=Ours, Setup=L_lambda_LK, η = 3, Temperature=12026.02 | 3.2 | 1.35 | |
| Eagle3target_model=Gemma4-12B2026.07 | 3.19 | — | |
| EAGLE-3Model=Qwen 3 235B A22B Instruct, Type=Ours, Setup=L_lambda_LK, η = 3, Temperature=12026.02 | 3.18 | 1.98 | |
| YH-70BModel=LLaMA 3.3 70B Instruct, Type=HF, Temperature=02026.02 | 3.13 | 2.5 | |
| EAGLE-3Model=GPT-OSS 20B, Type=Ours, Setup=KL, Temperature=12026.02 | 3.12 | 1.3 | |
| RH-70BModel=LLaMA 3.3 70B Instruct, Type=HF, Temperature=02026.02 | 3.11 | 2.35 | |
| EAGLE-3Model=Qwen 3 235B A22B Instruct, Type=Ours, Setup=L_alpha_LK, Temperature=12026.02 | 3.11 | 1.96 | |
| DFlashtarget_model=Qwen3-8B2026.07 | 3.11 | — | |
| DFlashtarget_model=Qwen3-14B2026.07 | 3.1 | — | |
| RH-8BModel=LLaMA 3.1 8B Instruct, Type=HF, Temperature=02026.02 | 3.08 | 2.09 | |
| DFlashtarget_model=Qwen3-4B2026.07 | 3.07 | — | |
| ZK-8BModel=LLaMA 3.1 8B Instruct, Type=HF, Temperature=12026.02 | 3.06 | 2.68 | |
| ZK-235BModel=Qwen 3 235B A22B Instruct, Type=HF, Temperature=02026.02 | 3.06 | 1.94 | |
| DFlashtarget_model=Gemma4-12B2026.07 | 2.98 | — | |
| YH-8BModel=LLaMA 3.1 8B Instruct, Type=HF, Temperature=12026.02 | 2.97 | 2.22 | |
| EAGLE-3Model=Qwen 3 235B A22B Instruct, Type=Ours, Setup=KL, Temperature=12026.02 | 2.96 | 1.84 | |
| RH-235BModel=Qwen 3 235B A22B Instruct, Type=HF, Temperature=02026.02 | 2.92 | 1.85 | |
| RH-20BModel=GPT-OSS 20B, Type=HF, Temperature=02026.02 | 2.9 | 1.26 | |
| DS-685BModel=DeepSeek V3 0324, Type=HF, Temperature=02026.02 | 2.9 | 1.66 | |
| RH-70BModel=LLaMA 3.3 70B Instruct, Type=HF, Temperature=12026.02 | 2.88 | 2.1 | |
| EAGLE-3Model=GPT-OSS 120B, Type=Ours, Setup=L_lambda_LK, η = 3, Temperature=02026.02 | 2.86 | 1.62 | |
| DS-685BModel=DeepSeek V3 0324, Type=HF, Temperature=12026.02 | 2.82 | 1.54 | |
| EAGLE-3Model=LLaMA 3.1 8B Instruct, Type=Ours, Setup=TV, Temperature=02026.02 | 2.81 | 1.96 | |
| EAGLE-3Model=GPT-OSS 120B, Type=Ours, Setup=KL, Temperature=02026.02 | 2.81 | 1.57 | |
| EAGLE-3Model=GPT-OSS 120B, Type=Ours, Setup=L_alpha_LK, Temperature=02026.02 | 2.8 | 1.59 | |
| YH-70BModel=LLaMA 3.3 70B Instruct, Type=HF, Temperature=12026.02 | 2.77 | 2.07 | |
| EAGLE-3Model=GPT-OSS 120B, Type=Ours, Setup=L_lambda_LK, η = 3, Temperature=12026.02 | 2.69 | 1.48 | |
| EAGLE-3Model=LLaMA 3.1 8B Instruct, Type=Ours, Setup=TV, Temperature=12026.02 | 2.67 | 1.83 | |
| RH-8BModel=LLaMA 3.1 8B Instruct, Type=HF, Temperature=12026.02 | 2.67 | 1.83 | |
| EAGLE-3Model=GPT-OSS 120B, Type=Ours, Setup=L_alpha_LK, Temperature=12026.02 | 2.67 | 1.49 | |
| Eagle3target_model=Qwen3-8B2026.07 | 2.66 | — | |
| ZK-235BModel=Qwen 3 235B A22B Instruct, Type=HF, Temperature=12026.02 | 2.64 | 1.63 | |
| RH-20BModel=GPT-OSS 20B, Type=HF, Temperature=12026.02 | 2.63 | 1.12 | |
| Eagle3target_model=Qwen3-14B2026.07 | 2.62 | — | |
| RH-235BModel=Qwen 3 235B A22B Instruct, Type=HF, Temperature=12026.02 | 2.56 | 1.61 | |
| EAGLE-3Model=GPT-OSS 120B, Type=Ours, Setup=KL, Temperature=12026.02 | 2.53 | 1.2 | |
| Eagle3target_model=Qwen3-4B2026.07 | 2.39 | — |