Free-form summarization on HELMET multi_lexsum
94.9UtilizationStill
Evaluation results
| Method | Links | |
|---|---|---|
| StillContext=8k2026.06 | 94.9 | |
| AMContext=8k2026.06 | 88 | |
| StillContext=16k2026.06 | 86.8 | |
| KV-DistillContext=8k2026.06 | 85.5 | |
| StillContext=32k2026.06 | 81.3 | |
| AMContext=16k2026.06 | 80.3 | |
| KV-DistillContext=16k2026.06 | 76 | |
| StillContext=64k2026.06 | 74 | |
| AMContext=32k2026.06 | 72.1 | |
| KV-DistillContext=32k2026.06 | 68.8 | |
| AMContext=64k2026.06 | 65.2 | |
| KV-DistillContext=64k2026.06 | 59.9 | |
| StillContext=128k2026.06 | 59.3 | |
| AMContext=128k2026.06 | 49.9 | |
| KV-DistillContext=128k2026.06 | 43.5 |