List your company
ResearchFormerly WizWand

Multi-turn Dialogue on MT-Bench (Speedup and tau)

4.55SpeedupBASTION
2.3662.9333.54.067May 28, 2026
Updated 5mo ago

Evaluation results

MethodLinks
BASTIONModel=Qwen3-4B, Decoding Mode=Stochastic Decoding, Temperature=12026.054.556.57
BASTIONModel=Qwen3-4B, Decoding Mode=Greedy Decoding, Temperature=02026.054.536.58
BASTIONModel=Qwen3-8B, Decoding Mode=Stochastic Decoding, Temperature=12026.054.326.32
BASTIONModel=Qwen3-8B, Decoding Mode=Greedy Decoding, Temperature=02026.054.316.28
DFlashModel=Qwen3-8B, Decoding Mode=Greedy Decoding, Temperature=02026.052.814.46
DFlashModel=Qwen3-4B, Decoding Mode=Greedy Decoding, Temperature=02026.052.744.63
EAGLE-3Model=Qwen3-4B, Decoding Mode=Greedy Decoding, Temperature=02026.052.692.48
EAGLE-3Model=Qwen3-8B, Decoding Mode=Greedy Decoding, Temperature=02026.052.682.24
DFlashModel=Qwen3-4B, Decoding Mode=Stochastic Decoding, Temperature=12026.052.654.21
DFlashModel=Qwen3-8B, Decoding Mode=Stochastic Decoding, Temperature=12026.052.64
EAGLE-3Model=Qwen3-4B, Decoding Mode=Stochastic Decoding, Temperature=12026.052.592.37
EAGLE-3Model=Qwen3-8B, Decoding Mode=Stochastic Decoding, Temperature=12026.052.452.04