General Evaluation on Average Across all benchmarks
6.9SpeedupBASTION
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| BASTIONModel=Qwen3-4B, Temperature=1, Hardware=H1002026.05 | 6.9 | 8.24 | |
| BASTIONModel=Qwen3-4B, Temperature=0, Hardware=H1002026.05 | 6.88 | 8.38 | |
| BASTIONModel=Qwen3-8B, Temperature=0, Hardware=H1002026.05 | 6.46 | 8.36 | |
| BASTIONModel=Qwen3-8B, Temperature=1, Hardware=H1002026.05 | 6.42 | 8.25 | |
| DFLAREModel=Q3-4B, Temperature=02026.06 | 5.52 | 7.47 | |
| DFLAREModel=Q3-8B, Temperature=02026.06 | 5.46 | 7.33 | |
| DFlashModel=Qwen3-4B, Temperature=0, Hardware=H100, Block size=162026.05 | 5.27 | 6.1 | |
| DFlashModel=Qwen3-8B, Temperature=0, Hardware=H100, Block size=162026.05 | 5.17 | 6.09 | |
| DFlashModel=Q3-8B, Temperature=02026.06 | 5.05 | 6.39 | |
| DFlashModel=Q3-4B, Temperature=02026.06 | 4.99 | 6.47 | |
| DFlashModel=Qwen3-4B, Temperature=1, Hardware=H100, Block size=162026.05 | 4.58 | 5.33 | |
| DFLAREModel=Q3-4B, Temperature=12026.06 | 4.53 | 6.21 | |
| DFlashModel=Qwen3-8B, Temperature=1, Hardware=H100, Block size=162026.05 | 4.35 | 5.19 | |
| DFlashModel=Q3-4B, Temperature=12026.06 | 4.35 | 5.6 | |
| DFLAREModel=Q3-8B, Temperature=12026.06 | 4.33 | 5.9 | |
| DFlashModel=Q3-8B, Temperature=12026.06 | 4.16 | 5.3 | |
| DFLAREModel=GPT-20B, Temperature=02026.06 | 3.91 | 4.93 | |
| DFlashModel=GPT-20B, Temperature=02026.06 | 3.71 | 4.66 | |
| EAGLE-3Model=Qwen3-4B, Temperature=0, Hardware=H100, Tree budget size=602026.05 | 2.99 | 2.47 | |
| EAGLE-3Model=Qwen3-4B, Temperature=1, Hardware=H100, Tree budget size=602026.05 | 2.75 | 2.33 | |
| EAGLE-3Model=Qwen3-8B, Temperature=0, Hardware=H100, Tree budget size=602026.05 | 2.6 | 2.29 | |
| DFLAREModel=GPT-20B, Temperature=12026.06 | 2.56 | 3.39 | |
| EAGLE-3Model=Qwen3-8B, Temperature=1, Hardware=H100, Tree budget size=602026.05 | 2.51 | 2.16 | |
| EAGLE3Model=Q3-4B, Temperature=02026.06 | 2.49 | 3.62 | |
| DFlashModel=GPT-20B, Temperature=12026.06 | 2.49 | 3.26 | |
| EAGLE3Model=Q3-8B, Temperature=02026.06 | 2.35 | 3.47 | |
| EAGLE3Model=Q3-4B, Temperature=12026.06 | 2.3 | 3.51 | |
| EAGLE3Model=Q3-8B, Temperature=12026.06 | 2.16 | 3.3 |