Question Answering on Natural Questions (Efficiency)
162.54Decoding Speed (tokens/s)EAGLE-3 + EVICT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| EAGLE-3 + EVICTTemperature=0, Backbone=Qwen3-30B-A3B2026.05 | 162.54 | — | |
| EAGLE-3 + EVICTTemperature=1, Backbone=Qwen3-30B-A3B2026.05 | 155.6 | — | |
| EAGLE-3Temperature=0, Backbone=Qwen3-30B-A3B2026.05 | 152.79 | — | |
| EAGLE-3Temperature=1, Backbone=Qwen3-30B-A3B2026.05 | 145.62 | — | |
| VanillaTemperature=0, Backbone=Qwen3-30B-A3B2026.05 | 144.62 | — | |
| VanillaTemperature=1, Backbone=Qwen3-30B-A3B2026.05 | 141.81 | — | |
| EAGLE-3 + DDDTemperature=0, Backbone=Qwen3-30B-A3B2026.05 | 140.22 | — | |
| EAGLE-3 + DDDTemperature=1, Backbone=Qwen3-30B-A3B2026.05 | 134.23 | — | |
| LookaheadTemperature=0, Backbone=Qwen3-30B-A3B2026.05 | 93.6 | — | |
| LookaheadTemperature=1, Backbone=Qwen3-30B-A3B2026.05 | 89.69 | — |