Stream Generation on StreamChat sequence length (4096×2, 4096×3]
35.5BLEU ScoreADORE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ADORE2024.07 | 35.5 | 37.7 | 67.1 | |
| H2O(Rebuilt)2024.07 | 28.9 | 33.2 | 64.7 | |
| H2O2024.07 | 26.2 | 32.5 | 64.2 | |
| StreamingLLM2024.07 | 18.6 | 28.4 | 62.4 | |
| KV Compression2024.07 | 16.4 | 21.5 | 56.2 | |
| Window Attention2024.07 | 16.1 | 18.1 | 50.1 | |
| Full Attention2024.07 | 2.1 | 2.4 | 30.1 | |
| Strided Attention2024.07 | 2 | 2.2 | 30 |