List your company
ResearchFormerly WizWand

Code on LCB

8.37SpeedupBASTION
1.9223.5965.276.944May 28, 2026
Updated 5mo ago

Evaluation results

MethodLinks
BASTIONModel=Qwen3-4B, Temperature=0, Hardware=H1002026.058.379.36
BASTIONModel=Qwen3-8B, Temperature=1, Hardware=H1002026.057.759.4
BASTIONModel=Qwen3-8B, Temperature=0, Hardware=H1002026.057.39.48
BASTIONModel=Qwen3-4B, Temperature=1, Hardware=H1002026.057.188.98
DFlashModel=Qwen3-8B, Temperature=0, Hardware=H100, Block size=162026.056.047.16
DFlashModel=Qwen3-4B, Temperature=0, Hardware=H100, Block size=162026.055.986.97
DFlashModel=Qwen3-4B, Temperature=1, Hardware=H100, Block size=162026.055.626.57
DFlashModel=Qwen3-8B, Temperature=1, Hardware=H100, Block size=162026.055.616.82
EAGLE-3Model=Qwen3-4B, Temperature=0, Hardware=H100, Tree budget size=602026.052.862.24
EAGLE-3Model=Qwen3-4B, Temperature=1, Hardware=H100, Tree budget size=602026.052.32.07
EAGLE-3Model=Qwen3-8B, Temperature=1, Hardware=H100, Tree budget size=602026.052.21.79
EAGLE-3Model=Qwen3-8B, Temperature=0, Hardware=H100, Tree budget size=602026.052.171.81