Code on LCB
8.37SpeedupBASTION
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| BASTIONModel=Qwen3-4B, Temperature=0, Hardware=H1002026.05 | 8.37 | 9.36 | |
| BASTIONModel=Qwen3-8B, Temperature=1, Hardware=H1002026.05 | 7.75 | 9.4 | |
| BASTIONModel=Qwen3-8B, Temperature=0, Hardware=H1002026.05 | 7.3 | 9.48 | |
| BASTIONModel=Qwen3-4B, Temperature=1, Hardware=H1002026.05 | 7.18 | 8.98 | |
| DFlashModel=Qwen3-8B, Temperature=0, Hardware=H100, Block size=162026.05 | 6.04 | 7.16 | |
| DFlashModel=Qwen3-4B, Temperature=0, Hardware=H100, Block size=162026.05 | 5.98 | 6.97 | |
| DFlashModel=Qwen3-4B, Temperature=1, Hardware=H100, Block size=162026.05 | 5.62 | 6.57 | |
| DFlashModel=Qwen3-8B, Temperature=1, Hardware=H100, Block size=162026.05 | 5.61 | 6.82 | |
| EAGLE-3Model=Qwen3-4B, Temperature=0, Hardware=H100, Tree budget size=602026.05 | 2.86 | 2.24 | |
| EAGLE-3Model=Qwen3-4B, Temperature=1, Hardware=H100, Tree budget size=602026.05 | 2.3 | 2.07 | |
| EAGLE-3Model=Qwen3-8B, Temperature=1, Hardware=H100, Tree budget size=602026.05 | 2.2 | 1.79 | |
| EAGLE-3Model=Qwen3-8B, Temperature=0, Hardware=H100, Tree budget size=602026.05 | 2.17 | 1.81 |