Multi-turn Conversation on MT-Bench (MAT and Speed Metrics)
7.29MAT ScoreTALON
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| TALONModel=Vicuna-13B, Temperature=02026.01 | 7.29 | 4.27 | |
| EAGLE-3Model=Vicuna-13B, Temperature=02026.01 | 7.12 | 4.05 | |
| OPT-TreeModel=Vicuna-13B, Temperature=02026.01 | 6.95 | 3.75 | |
| EAGLE-3Model=Llama3-8B, Temperature=02026.01 | 6.38 | 3.67 | |
| TALONModel=Llama3-8B, Temperature=02026.01 | 6.22 | 3.85 | |
| EAGLE-3Model=DSL-8B, Temperature=02026.01 | 5.82 | 3.33 | |
| TALONModel=DSL-8B, Temperature=02026.01 | 5.45 | 3.56 | |
| HYDRAModel=Vicuna-13B, Temperature=02026.01 | 3.64 | 2.46 | |
| EAGLE-3Model=Qwen3-8B, Temperature=02026.01 | 3.64 | 2.2 | |
| TALONModel=Qwen3-8B, Temperature=02026.01 | 3.6 | 2.57 | |
| EAGLE-3Model=Qwen3-32B, Temperature=02026.01 | 2.98 | 1.9 | |
| TALONModel=Qwen3-32B, Temperature=02026.01 | 2.94 | 2.1 | |
| MEDUSAModel=Vicuna-13B, Temperature=02026.01 | 2.58 | 2.01 | |
| SDModel=Vicuna-13B, Temperature=02026.01 | 2.51 | 1.29 |