Code generation on MT-Bench (test)
3.934Speedup RatioEagle1
Evaluation Results
| Method | Links | |
|---|---|---|
| Eagle1Drafter=Eagle1 (Specialized), Type=White-box SD, Hardware=NVIDIA A100 GPU, Decoding=Greedy2026.04 | 3.934 | |
| Eagle-OFADrafter=OFA (One-Size-Fits-All), Type=White-box SD, Hardware=NVIDIA A100 GPU, Decoding=Greedy2026.04 | 3.776 | |
| MetaEagle-UCBBandit algorithm=UCB, Type=White-box SD, Hardware=NVIDIA A100 GPU, Decoding=Greedy2026.04 | 3.724 | |
| MetaEagle-SHBandit algorithm=SH, Type=White-box SD, Hardware=NVIDIA A100 GPU, Decoding=Greedy2026.04 | 3.65 | |
| MetaEagle-EXP3Bandit algorithm=EXP3, Type=White-box SD, Hardware=NVIDIA A100 GPU, Decoding=Greedy2026.04 | 2.858 | |
| R-MedusaType=White-box SD, Hardware=NVIDIA A100 GPU, Decoding=Greedy2026.04 | 2.822 | |
| MedusaType=White-box SD, Hardware=NVIDIA A100 GPU, Decoding=Greedy2026.04 | 2.661 | |
| Drafter1Drafter Specialization=1: Code2026.04 | 2.437 | |
| OFADrafter Type=One-Size-Fits-All2026.04 | 2.435 | |
| Eagle5Drafter=Eagle5 (Specialized), Type=White-box SD, Hardware=NVIDIA A100 GPU, Decoding=Greedy2026.04 | 2.427 | |
| MetaEagle-RandBandit algorithm=Rand, Type=White-box SD, Hardware=NVIDIA A100 GPU, Decoding=Greedy2026.04 | 2.31 | |
| MetaSpS-UCBBandit Selection=UCB2026.04 | 2.3 | |
| Eagle4Drafter=Eagle4 (Specialized), Type=White-box SD, Hardware=NVIDIA A100 GPU, Decoding=Greedy2026.04 | 2.15 | |
| MetaSpS-SHBandit Selection=SH2026.04 | 2.148 | |
| R-BPDType=White-box SD, Hardware=NVIDIA A100 GPU, Decoding=Greedy2026.04 | 2.146 | |
| BPDType=White-box SD, Hardware=NVIDIA A100 GPU, Decoding=Greedy2026.04 | 1.963 | |
| PLDMethod Type=Other2026.04 | 1.923 | |
| MetaSpS-EXP3Bandit Selection=EXP32026.04 | 1.919 | |
| Drafter4Drafter Specialization=4: QA2026.04 | 1.814 | |
| Eagle3Drafter=Eagle3 (Specialized), Type=White-box SD, Hardware=NVIDIA A100 GPU, Decoding=Greedy2026.04 | 1.776 | |
| Drafter5Drafter Specialization=5: Math2026.04 | 1.687 | |
| MetaSpS-RandBandit Selection=Rand2026.04 | 1.64 | |
| Drafter3Drafter Specialization=3: Summarization2026.04 | 1.565 | |
| LookaheadMethod Type=Other2026.04 | 1.542 | |
| Eagle2Drafter=Eagle2 (Specialized), Type=White-box SD, Hardware=NVIDIA A100 GPU, Decoding=Greedy2026.04 | 1.303 | |
| Drafter2Drafter Specialization=2: Translation2026.04 | 1.224 |