Summarization on ArXiv March23
40.35ROUGE-1Original LLM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Original LLMCompression Constraint=None2025.12 | 40.35 | 16.22 | 27.22 | 81.57 | 34.88 | |
| AdmTreeCompression Constraint=2x2025.12 | 36.1 | 15.69 | 26.6 | 79.83 | 35.99 | |
| AdmTreeCompression Constraint=4x2025.12 | 35.51 | 15.06 | 25.84 | 79.97 | 34.82 | |
| BeaconCompression Constraint=2x2025.12 | 35.42 | 15.47 | 25.91 | 77.69 | 16.05 | |
| SnapKVCompression Constraint=2x2025.12 | 33.23 | 12.56 | 25.1 | 73.09 | 30.23 | |
| BeaconCompression Constraint=4x2025.12 | 32.18 | 14.12 | 23.96 | 74.25 | 17.22 | |
| LongLLMLinguaCompression Constraint=2x2025.12 | 31.78 | 9.29 | 20.01 | 74.24 | 24.81 | |
| SnapKVCompression Constraint=4x2025.12 | 31.25 | 8.92 | 20.53 | 70.21 | 23.21 | |
| LongLLMLinguaCompression Constraint=4x2025.12 | 29.3 | 7.43 | 18.2 | 69.04 | 26.36 | |
| ICAECompression Constraint=2x2025.12 | 12.87 | 1.03 | 8.42 | 15.25 | 15.77 | |
| ICAECompression Constraint=4x2025.12 | 10.56 | 0.89 | 7.65 | 13.21 | 13.52 | |
| AutoCompressorCompression Constraint=2x2025.12 | 9.05 | 0.24 | 6.31 | 12.43 | 5.05 | |
| AutoCompressorCompression Constraint=4x2025.12 | 7.69 | 0.21 | 5.21 | 11.36 | 4.21 |