Speculative Decoding on Alpamayo (on-shelf test)
6.99Accepted Length LFlatRoPE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FlatRoPEDraft=EAGLE-32026.06 | 6.99 | 4.11 | |
| FlatRoPE + AARLDraft=EAGLE-32026.06 | 6.95 | 4.08 | |
| 3D M-RoPEDraft=EAGLE-32026.06 | 6.93 | 3.98 | |
| FlatRoPE + AARLDraft=Dflash2026.06 | 4.67 | 3.97 | |
| FlatRoPEDraft=Dflash2026.06 | 4.65 | 3.97 | |
| 3D M-RoPEDraft=Dflash2026.06 | 4.19 | 3.54 |