List your company
ResearchFormerly WizWand

Multi-turn Dialogue Response Generation on MT-bench (test)

2.78Speedup Ratio (γ)CTC-drafter
0.92881.40941.892.3706Nov 25, 2024
Updated 8mo ago

Evaluation results

MethodLinks
CTC-drafterBase Model=Vicuna-7B2024.112.783.56
CTC-drafterBase Model=Vicuna-13B2024.112.523.51
HydraBase Model=Vicuna-7B2024.112.363.04
CTC-drafterBase Model=Vicuna-33B2024.112.23.53
HydraBase Model=Vicuna-13B2024.112.173.06
HydraBase Model=Vicuna-33B2024.112.152.95
MedusaBase Model=Vicuna-7B2024.112.132.58
MedusaBase Model=Vicuna-13B2024.111.972.6
MedusaBase Model=Vicuna-33B2024.111.932.55
VanillaBase Model=Vicuna-7B2024.1111
VanillaBase Model=Vicuna-13B2024.1111
VanillaBase Model=Vicuna-33B2024.1111