Summarization on MultiNews (F1)
34.79F1 ScoreOriginal Prompt
Evaluation Results
| Method | Links | |
|---|---|---|
| Original PromptBackbone=LLaMA-3.1-8B-Instruct2026.02 | 34.79 | |
| Original PromptBackbone=Qwen3-4B-Instruct2026.02 | 32.09 | |
| RAMBackbone=Qwen3-4B-Instruct, Compression=4x2026.02 | 32.07 | |
| EXITBackbone=Qwen3-4B-Instruct, Compression=4x2026.02 | 31.86 | |
| ProvenceBackbone=LLaMA-3.1-8B-Instruct, Compression=4x2026.02 | 30.14 | |
| LLMLingua-2-largeBackbone=LLaMA-3.1-8B-Instruct, Compression=4x2026.02 | 30.08 | |
| EXITBackbone=LLaMA-3.1-8B-Instruct, Compression=4x2026.02 | 29.71 | |
| LLMLingua-2-largeBackbone=Qwen3-4B-Instruct, Compression=4x2026.02 | 29.56 | |
| RAMBackbone=LLaMA-3.1-8B-Instruct, Compression=4x2026.02 | 29.21 | |
| Activation BeaconBackbone=LLaMA-3.1-8B-Instruct, Compression=4x2026.02 | 28.52 | |
| RAMBackbone=Qwen3-4B-Instruct, Compression=8x2026.02 | 28.5 | |
| ProvenceBackbone=Qwen3-4B-Instruct, Compression=4x2026.02 | 28.3 | |
| ICAEBackbone=LLaMA-3.1-8B-Instruct, Compression=4x2026.02 | 28.16 | |
| EXITBackbone=Qwen3-4B-Instruct, Compression=8x2026.02 | 28.07 | |
| ICAEBackbone=LLaMA-3.1-8B-Instruct, Compression=8x2026.02 | 27.92 | |
| LLMLingua-2-largeBackbone=LLaMA-3.1-8B-Instruct, Compression=8x2026.02 | 27.55 | |
| EXITBackbone=LLaMA-3.1-8B-Instruct, Compression=8x2026.02 | 27.15 | |
| LLMLingua-2-largeBackbone=Qwen3-4B-Instruct, Compression=8x2026.02 | 26.41 | |
| LongLLMLinguaBackbone=LLaMA-3.1-8B-Instruct, Compression=4x2026.02 | 26.32 | |
| ProvenceBackbone=LLaMA-3.1-8B-Instruct, Compression=8x2026.02 | 26.19 | |
| RAMBackbone=LLaMA-3.1-8B-Instruct, Compression=8x2026.02 | 26.11 | |
| Activation BeaconBackbone=LLaMA-3.1-8B-Instruct, Compression=8x2026.02 | 25.19 | |
| ProvenceBackbone=Qwen3-4B-Instruct, Compression=8x2026.02 | 24.47 | |
| LongLLMLinguaBackbone=Qwen3-4B-Instruct, Compression=4x2026.02 | 24.15 | |
| ICAEBackbone=Qwen3-4B-Instruct, Compression=8x2026.02 | 23.42 | |
| ICAEBackbone=Qwen3-4B-Instruct, Compression=4x2026.02 | 22.78 | |
| LongLLMLinguaBackbone=LLaMA-3.1-8B-Instruct, Compression=8x2026.02 | 21.56 | |
| LongLLMLinguaBackbone=Qwen3-4B-Instruct, Compression=8x2026.02 | 20.48 |