Mathematical Reasoning on MATH 500 (Speedup Ratio, Average Acceptance Length (τ))
6.17Speedup RatioBlockPilot
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BlockPilotModel=Qwen3-8B, Temperature=02026.06 | 6.17 | 8.56 | |
| DFlashModel=Qwen3-8B, Temperature=0, Block size (n)=162026.06 | 5.98 | 8.29 | |
| DFlashModel=Qwen3-8B, Temperature=0, Block size (n)=322026.06 | 5.66 | 7.84 | |
| BlockPilotModel=Qwen3-4B, Temperature=02026.06 | 5.45 | 8.62 | |
| BlockPilotModel=Qwen3-4B, Temperature=12026.06 | 5.41 | 7.53 | |
| DFlashModel=Qwen3-4B, Temperature=0, Block size (n)=162026.06 | 5.25 | 8.31 | |
| BlockPilotModel=Qwen3-8B, Temperature=12026.06 | 5.06 | 7.25 | |
| DFlashModel=Qwen3-4B, Temperature=1, Block size (n)=162026.06 | 4.83 | 6.72 | |
| DFlashModel=Qwen3-8B, Temperature=1, Block size (n)=162026.06 | 4.62 | 6.62 | |
| DFlashModel=Qwen3-8B, Temperature=1, Block size (n)=322026.06 | 4.41 | 6.32 | |
| DFlashModel=Qwen3-8B, Temperature=0, Block size (n)=82026.06 | 4.09 | 5.67 | |
| DFlashModel=Qwen3-4B, Temperature=1, Block size (n)=82026.06 | 3.71 | 5.16 | |
| DFlashModel=Qwen3-4B, Temperature=0, Block size (n)=82026.06 | 3.59 | 5.68 | |
| DFlashModel=Qwen3-8B, Temperature=1, Block size (n)=82026.06 | 3.53 | 5.06 | |
| DFlashModel=Qwen3-4B, Temperature=1, Block size (n)=322026.06 | 3.35 | 4.66 | |
| DFlashModel=Qwen3-4B, Temperature=0, Block size (n)=322026.06 | 3.22 | 5.09 | |
| DFlashModel=Qwen3-8B, Temperature=0, Block size (n)=42026.06 | 2.5 | 3.47 | |
| DFlashModel=Qwen3-4B, Temperature=1, Block size (n)=42026.06 | 2.34 | 3.26 | |
| DFlashModel=Qwen3-8B, Temperature=1, Block size (n)=42026.06 | 2.25 | 3.22 | |
| DFlashModel=Qwen3-4B, Temperature=0, Block size (n)=42026.06 | 2.2 | 3.48 | |
| EAGLE-3Model=Qwen3-4B, Temperature=02026.06 | 1.83 | 3.08 | |
| EAGLE-3Model=Qwen3-8B, Temperature=02026.06 | 1.81 | 3.02 | |
| EAGLE-3Model=Qwen3-4B, Temperature=12026.06 | 1.75 | 2.99 | |
| EAGLE-3Model=Qwen3-8B, Temperature=12026.06 | 1.73 | 2.91 |