Mathematical Reasoning on AIME24 (Speedup Ratio, Average Acceptance Length)
6.16Speedup RatioBlockPilot
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BlockPilotModel=Qwen3-8B, Temperature=02026.06 | 6.16 | 8.3 | |
| DFlashModel=Qwen3-8B, Temperature=0, Block size (n)=162026.06 | 5.57 | 7.51 | |
| DFlashModel=Qwen3-8B, Temperature=0, Block size (n)=322026.06 | 5.2 | 7.01 | |
| BlockPilotModel=Qwen3-4B, Temperature=02026.06 | 4.8 | 7.82 | |
| DFlashModel=Qwen3-4B, Temperature=0, Block size (n)=162026.06 | 4.58 | 7.45 | |
| DFlashModel=Qwen3-8B, Temperature=0, Block size (n)=82026.06 | 4.22 | 5.69 | |
| BlockPilotModel=Qwen3-4B, Temperature=12026.06 | 4.02 | 5.6 | |
| BlockPilotModel=Qwen3-8B, Temperature=12026.06 | 3.84 | 5.47 | |
| DFlashModel=Qwen3-4B, Temperature=1, Block size (n)=162026.06 | 3.66 | 5.1 | |
| DFlashModel=Qwen3-8B, Temperature=1, Block size (n)=162026.06 | 3.49 | 4.98 | |
| DFlashModel=Qwen3-4B, Temperature=0, Block size (n)=82026.06 | 3.47 | 5.64 | |
| DFlashModel=Qwen3-8B, Temperature=1, Block size (n)=322026.06 | 3.39 | 4.84 | |
| DFlashModel=Qwen3-4B, Temperature=0, Block size (n)=322026.06 | 2.99 | 4.86 | |
| DFlashModel=Qwen3-4B, Temperature=1, Block size (n)=82026.06 | 2.97 | 4.13 | |
| DFlashModel=Qwen3-8B, Temperature=1, Block size (n)=82026.06 | 2.92 | 4.17 | |
| DFlashModel=Qwen3-4B, Temperature=1, Block size (n)=322026.06 | 2.79 | 3.88 | |
| DFlashModel=Qwen3-8B, Temperature=0, Block size (n)=42026.06 | 2.55 | 3.44 | |
| DFlashModel=Qwen3-4B, Temperature=0, Block size (n)=42026.06 | 2.12 | 3.45 | |
| DFlashModel=Qwen3-4B, Temperature=1, Block size (n)=42026.06 | 2.08 | 2.9 | |
| DFlashModel=Qwen3-8B, Temperature=1, Block size (n)=42026.06 | 2.05 | 2.92 | |
| EAGLE-3Model=Qwen3-4B, Temperature=02026.06 | 1.79 | 3.05 | |
| EAGLE-3Model=Qwen3-8B, Temperature=02026.06 | 1.79 | 3 | |
| EAGLE-3Model=Qwen3-4B, Temperature=12026.06 | 1.64 | 2.79 | |
| EAGLE-3Model=Qwen3-8B, Temperature=12026.06 | 1.63 | 2.74 |