Multi-turn Conversation Evaluation on MT-bench (Speedup, tau)
3.82SpeedupEagle3+LTD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Eagle3+LTDModel=Vicuna-13B-v1.3, Temperature=12026.03 | 3.82 | 6.4 | |
| Eagle3+Spec++Model=Vicuna-13B-v1.3, Temperature=12026.03 | 3.61 | 5.58 | |
| Eagle3Model=Vicuna-13B-v1.3, Temperature=12026.03 | 3.6 | 5.55 | |
| Eagle3+GSModel=Vicuna-13B-v1.3, Temperature=12026.03 | 3.58 | 6.3 | |
| Eagle3+DiscoModel=Vicuna-13B-v1.3, Temperature=12026.03 | 3.48 | 5.55 | |
| Eagle3+GTModel=Vicuna-13B-v1.3, Temperature=12026.03 | 3.43 | 5.36 | |
| Eagle3+DDDModel=Vicuna-13B-v1.3, Temperature=12026.03 | 3.4 | 5.05 | |
| Eagle3+C2TModel=Vicuna-13B-v1.3, Temperature=12026.03 | 3.38 | 5.66 | |
| Eagle3+SvipModel=Vicuna-13B-v1.3, Temperature=12026.03 | 3.18 | 5.73 | |
| Eagle3+LTDModel=DeepSeek-R1-Distill-LLaMA 8B, Temperature=12026.03 | 3.18 | 5.2 | |
| Eagle3Model=DeepSeek-R1-Distill-LLaMA 8B, Temperature=12026.03 | 3.07 | 4.74 | |
| Eagle3+GSModel=DeepSeek-R1-Distill-LLaMA 8B, Temperature=12026.03 | 3.05 | 5.19 | |
| Eagle3+Spec++Model=Llama-3.1-8B-Instruct, Temperature=12026.03 | 2.92 | 4.2 | |
| Eagle3+DDDModel=Llama-3.1-8B-Instruct, Temperature=12026.03 | 2.89 | 3.4 | |
| Eagle3Model=Llama-3.1-8B-Instruct, Temperature=12026.03 | 2.85 | 4.11 | |
| Eagle3+LTDModel=Llama-3.1-8B-Instruct, Temperature=12026.03 | 2.85 | 4.02 | |
| Eagle3+DiscoModel=Llama-3.1-8B-Instruct, Temperature=12026.03 | 2.82 | 3.82 | |
| Eagle3+GSModel=Llama-3.1-8B-Instruct, Temperature=12026.03 | 2.79 | 4.08 | |
| Eagle3+C2TModel=Llama-3.1-8B-Instruct, Temperature=12026.03 | 2.78 | 4.11 | |
| Eagle3+GTModel=Llama-3.1-8B-Instruct, Temperature=12026.03 | 2.75 | 3.54 | |
| Eagle3+SvipModel=Llama-3.1-8B-Instruct, Temperature=12026.03 | 2.74 | 3.41 | |
| Eagle3+LTDModel=Qwen3 32B, Temperature=12026.03 | 2.17 | 2.78 | |
| Eagle3+LTDModel=Qwen3 14B, Temperature=12026.03 | 2.16 | 3.11 | |
| Eagle3+GSModel=Qwen3 14B, Temperature=12026.03 | 2.05 | 3.13 | |
| Eagle3+GSModel=Qwen3 32B, Temperature=12026.03 | 1.56 | 2.89 |