Long-context Summarization on L-Eval Sum
22.66QMSDRIFT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DRIFTComp. Ratio=32×, Backbone=Qwen2.5-Instruct-7B2026.02 | 22.66 | 19.01 | 21.02 | |
| DRIFTComp. Ratio=64×, Backbone=Mistral-7B-v0.22026.02 | 21.95 | 19.49 | 20.85 | |
| DRIFTComp. Ratio=32×, Backbone=Mistral-7B-v0.22026.02 | 21.59 | 19.75 | 20.76 | |
| Qwen2.5-Instruct-7BComp. Ratio=1×2026.02 | 20.74 | 18.5 | 19.74 | |
| DRIFTComp. Ratio=128×, Backbone=Mistral-7B-v0.22026.02 | 20.69 | 19.14 | 19.99 | |
| NaiveRAGComp. Ratio=-, Backbone=Mistral-7B-v0.22026.02 | 19.61 | 18.11 | 18.94 | |
| LLMLingua-2Comp. Ratio=3×, Backbone=Mistral-7B-v0.22026.02 | 19.37 | 18.86 | 19.14 | |
| Mistral-7B-v0.2Comp. Ratio=1×2026.02 | 19.32 | 18.9 | 19.13 | |
| xRAGComp. Ratio=128×, Backbone=Mistral-7B-v0.22026.02 | 18.06 | 12.34 | 15.49 | |
| ICAEComp. Ratio=4×, Backbone=Mistral-7B-v0.22026.02 | 17.62 | 13.27 | 15.67 | |
| COCOMComp. Ratio=4×, Backbone=Mistral-7B-v0.22026.02 | 9.15 | 7.79 | 8.54 | |
| COCOMComp. Ratio=128×, Backbone=Mistral-7B-v0.22026.02 | 8.71 | 4.79 | 6.95 | |
| COCOMComp. Ratio=16×, Backbone=Mistral-7B-v0.22026.02 | 7.78 | 5.37 | 6.7 |