Summarization on LongBench Summary (test)
37.68ScoreATACompressor
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ATACompressorBackbone=Qwen-2-7B2026.02 | 37.68 | 24.79 | 1.94 | — | |
| QGCBackbone=Qwen-2-7B2026.02 | 33.23 | 15.18 | 1.13 | — | |
| 500CompressorBackbone=Qwen-2-7B2026.02 | 31.43 | 21.45 | 1.81 | — | |
| ICAEBackbone=Qwen-2-7B2026.02 | 30.09 | 21.38 | 1.88 | — | |
| LongLLMLinguaBackbone=Qwen-2-7B2026.02 | 29.21 | 5.24 | 0.93 | — | |
| InfLLMContext Window=40962026.03 | 28.58 | — | — | 4,096 | |
| TokenSelectContext Window=40962026.03 | 28.48 | — | — | 4,096 | |
| UT-ACAMaximum Block Budget=32, Update=Sub.162026.03 | 28.43 | — | — | 3,508 | |
| TokenSelectContext Window=20482026.03 | 28.29 | — | — | 2,048 | |
| InfLLMContext Window=20482026.03 | 27.87 | — | — | 2,048 | |
| TokenSelectContext Window=10242026.03 | 27.78 | — | — | 1,024 | |
| UT-ACAMaximum Block Budget=16, Update=Sub.82026.03 | 27.64 | — | — | 1,610 | |
| UT-ACAMaximum Block Budget=8, Update=Sub.42026.03 | 27.46 | — | — | 609 | |
| InfLLMContext Window=10242026.03 | 27.24 | — | — | 1,024 | |
| Original-ContextBackbone=Qwen-2-7B2026.02 | 26.32 | 1 | 0.86 | — | |
| Selective-ContextBackbone=Qwen-2-7B2026.02 | 22.13 | 3.82 | 0.88 | — | |
| Closed-bookBackbone=Qwen-2-7B2026.02 | 10.43 | — | 3.04 | — |