General Efficiency on Overall Avg.
4.66Speedup RatioBlockPilot
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BlockPilotModel=Qwen3-8B, Temperature=02026.06 | 4.66 | 6.46 | |
| DFlashModel=Qwen3-8B, Temperature=0, Block size (n)=162026.06 | 4.42 | 6.13 | |
| BlockPilotModel=Qwen3-4B, Temperature=12026.06 | 4.2 | 5.92 | |
| BlockPilotModel=Qwen3-4B, Temperature=02026.06 | 4.17 | 6.59 | |
| DFlashModel=Qwen3-8B, Temperature=0, Block size (n)=322026.06 | 4.11 | 5.7 | |
| DFlashModel=Qwen3-4B, Temperature=0, Block size (n)=162026.06 | 3.99 | 6.31 | |
| BlockPilotModel=Qwen3-8B, Temperature=12026.06 | 3.94 | 5.55 | |
| DFlashModel=Qwen3-4B, Temperature=1, Block size (n)=162026.06 | 3.8 | 5.35 | |
| DFlashModel=Qwen3-8B, Temperature=1, Block size (n)=162026.06 | 3.55 | 5 | |
| DFlashModel=Qwen3-8B, Temperature=0, Block size (n)=82026.06 | 3.41 | 4.73 | |
| DFlashModel=Qwen3-8B, Temperature=1, Block size (n)=322026.06 | 3.37 | 4.75 | |
| DFlashModel=Qwen3-4B, Temperature=1, Block size (n)=82026.06 | 3.04 | 4.26 | |
| DFlashModel=Qwen3-4B, Temperature=0, Block size (n)=82026.06 | 2.99 | 4.73 | |
| DFlashModel=Qwen3-8B, Temperature=1, Block size (n)=82026.06 | 2.89 | 4.08 | |
| DFlashModel=Qwen3-4B, Temperature=1, Block size (n)=322026.06 | 2.61 | 3.66 | |
| DFlashModel=Qwen3-4B, Temperature=0, Block size (n)=322026.06 | 2.53 | 4 | |
| DFlashModel=Qwen3-8B, Temperature=0, Block size (n)=42026.06 | 2.25 | 3.13 | |
| DFlashModel=Qwen3-4B, Temperature=1, Block size (n)=42026.06 | 2.1 | 2.95 | |
| DFlashModel=Qwen3-8B, Temperature=1, Block size (n)=42026.06 | 2.03 | 2.86 | |
| DFlashModel=Qwen3-4B, Temperature=0, Block size (n)=42026.06 | 1.99 | 3.15 | |
| EAGLE-3Model=Qwen3-8B, Temperature=02026.06 | 1.75 | 2.93 | |
| EAGLE-3Model=Qwen3-4B, Temperature=02026.06 | 1.7 | 2.95 | |
| EAGLE-3Model=Qwen3-4B, Temperature=12026.06 | 1.7 | 2.88 | |
| EAGLE-3Model=Qwen3-8B, Temperature=12026.06 | 1.65 | 2.77 |