Long-context Reasoning on BAMBOO 16k
41.5AltQA ScoreDRIFT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DRIFTComp. Ratio=32×, Backbone=Mistral-7B-v0.22026.02 | 41.5 | 80 | 77.78 | 60.15 | |
| LLMLingua-2Comp. Ratio=3×, Backbone=Mistral-7B-v0.22026.02 | 40 | 75 | 76.77 | 57.89 | |
| Mistral-7B-v0.2Comp. Ratio=1×2026.02 | 40 | 75 | 76.77 | 57.89 | |
| DRIFTComp. Ratio=32×, Backbone=Qwen2.5-Instruct-7B2026.02 | 37 | 81 | 84.85 | 59.9 | |
| DRIFTComp. Ratio=64×, Backbone=Mistral-7B-v0.22026.02 | 36 | 82 | 82.83 | 59.15 | |
| DRIFTComp. Ratio=128×, Backbone=Mistral-7B-v0.22026.02 | 36 | 77 | 78.79 | 56.89 | |
| Qwen2.5-Instruct-7BComp. Ratio=1×2026.02 | 36 | 78 | 82.83 | 58.15 | |
| NaiveRAGComp. Ratio=-, Backbone=Mistral-7B-v0.22026.02 | 34.5 | 79 | 75.76 | 55.89 | |
| COCOMComp. Ratio=4×, Backbone=Mistral-7B-v0.22026.02 | 30.5 | 60 | 47.47 | 42.11 | |
| COCOMComp. Ratio=16×, Backbone=Mistral-7B-v0.22026.02 | 25.5 | 49 | 41.41 | 35.34 | |
| xRAGComp. Ratio=128×, Backbone=Mistral-7B-v0.22026.02 | 25 | 68 | 57.58 | 43.86 | |
| ICAEComp. Ratio=4×, Backbone=Mistral-7B-v0.22026.02 | 21.5 | 19 | 19.19 | 20.3 | |
| COCOMComp. Ratio=128×, Backbone=Mistral-7B-v0.22026.02 | 15 | 40 | 36.36 | 26.57 |