Speculative Decoding on Wikipedia
3.21SpeedupNextLat
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| NextLatd=22025.11 | 3.21 | 4.59 | |
| NextLatd=22025.11 | 3.21 | 4.59 | |
| NextLatd=12025.11 | 2.68 | 3.52 | |
| NextLatd=12025.11 | 2.68 | 3.52 | |
| JTPd=42025.11 | 2.58 | 3.32 | |
| MTPd=42025.11 | 2.1 | 3.04 | |
| JTPd=22025.11 | 1.88 | 1.84 | |
| JTPd=22025.11 | 1.88 | 1.84 | |
| MTPd=22025.11 | 1.68 | 1.72 | |
| MTPd=22025.11 | 1.68 | 1.72 | |
| JTPd=12025.11 | 1.46 | 0.96 | |
| JTPd=12025.11 | 1.46 | 0.96 | |
| MTPd=12025.11 | 1.38 | 0.91 | |
| MTPd=12025.11 | 1.38 | 0.91 |