Stream Generation on StreamChat sequence length (4096×3, 4096×4]
36.7BLEUADORE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ADORE2024.07 | 36.7 | 39.5 | 69.1 | |
| H2O(Rebuilt)2024.07 | 30.4 | 34.9 | 66.7 | |
| H2O2024.07 | 27.3 | 32.4 | 65.6 | |
| StreamingLLM2024.07 | 21.7 | 27.5 | 63.5 | |
| Window Attention2024.07 | 19.9 | 20.4 | 52.1 | |
| KV Compression2024.07 | 16.9 | 22 | 57.4 | |
| Full Attention2024.07 | 2 | 2.4 | 30 | |
| Strided Attention2024.07 | 2 | 2.1 | 29.6 |