Stream Generation on StreamChat sequence length (4096, 4096×2]
36.5BLEUADORE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ADORE2024.07 | 36.5 | 39.2 | 67.7 | |
| H2O(Rebuilt)2024.07 | 30.7 | 34.3 | 65.8 | |
| H2O2024.07 | 28.3 | 32.7 | 64.9 | |
| KV Compression2024.07 | 18.3 | 24.5 | 59.1 | |
| StreamingLLM2024.07 | 14.8 | 29 | 63.2 | |
| Window Attention2024.07 | 14.2 | 19.6 | 54.3 | |
| Full Attention2024.07 | 3.6 | 4.9 | 33.1 | |
| Strided Attention2024.07 | 2.1 | 3 | 29.7 |