List your company
ResearchFormerly WizWand

General Evaluation on Average Across all benchmarks

6.9SpeedupBASTION
1.97043.25024.535.8098May 28, 2026May 29, 2026May 30, 2026May 31, 2026Jun 1, 2026
Updated 5mo ago

Evaluation results

MethodLinks
BASTIONModel=Qwen3-4B, Temperature=1, Hardware=H1002026.056.98.24
BASTIONModel=Qwen3-4B, Temperature=0, Hardware=H1002026.056.888.38
BASTIONModel=Qwen3-8B, Temperature=0, Hardware=H1002026.056.468.36
BASTIONModel=Qwen3-8B, Temperature=1, Hardware=H1002026.056.428.25
DFLAREModel=Q3-4B, Temperature=02026.065.527.47
DFLAREModel=Q3-8B, Temperature=02026.065.467.33
DFlashModel=Qwen3-4B, Temperature=0, Hardware=H100, Block size=162026.055.276.1
DFlashModel=Qwen3-8B, Temperature=0, Hardware=H100, Block size=162026.055.176.09
DFlashModel=Q3-8B, Temperature=02026.065.056.39
DFlashModel=Q3-4B, Temperature=02026.064.996.47
DFlashModel=Qwen3-4B, Temperature=1, Hardware=H100, Block size=162026.054.585.33
DFLAREModel=Q3-4B, Temperature=12026.064.536.21
DFlashModel=Qwen3-8B, Temperature=1, Hardware=H100, Block size=162026.054.355.19
DFlashModel=Q3-4B, Temperature=12026.064.355.6
DFLAREModel=Q3-8B, Temperature=12026.064.335.9
DFlashModel=Q3-8B, Temperature=12026.064.165.3
DFLAREModel=GPT-20B, Temperature=02026.063.914.93
DFlashModel=GPT-20B, Temperature=02026.063.714.66
EAGLE-3Model=Qwen3-4B, Temperature=0, Hardware=H100, Tree budget size=602026.052.992.47
EAGLE-3Model=Qwen3-4B, Temperature=1, Hardware=H100, Tree budget size=602026.052.752.33
EAGLE-3Model=Qwen3-8B, Temperature=0, Hardware=H100, Tree budget size=602026.052.62.29
DFLAREModel=GPT-20B, Temperature=12026.062.563.39
EAGLE-3Model=Qwen3-8B, Temperature=1, Hardware=H100, Tree budget size=602026.052.512.16
EAGLE3Model=Q3-4B, Temperature=02026.062.493.62
DFlashModel=GPT-20B, Temperature=12026.062.493.26
EAGLE3Model=Q3-8B, Temperature=02026.062.353.47
EAGLE3Model=Q3-4B, Temperature=12026.062.33.51
EAGLE3Model=Q3-8B, Temperature=12026.062.163.3