Question Answering on MSMARCO (test)
53.3F1 ScoreATACompressor
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ATACompressorBackbone=Qwen-2-7B2026.02 | 53.3 | 8.15 | 25.32 | 1.35 | |
| ATACompressorBackbone=LLaMA-2-7B2026.02 | 50.06 | 8 | 27.36 | 1.29 | |
| QGCBackbone=Qwen-2-7B2026.02 | 49.8 | 6.1 | 16.72 | 0.79 | |
| 500CompressorBackbone=Qwen-2-7B2026.02 | 47.2 | 5.3 | 14.58 | 1.24 | |
| ICAEBackbone=Qwen-2-7B2026.02 | 46.23 | 5.15 | 14.58 | 1.25 | |
| QGCBackbone=LLaMA-2-7B2026.02 | 44.2 | 5.2 | 15.76 | 0.81 | |
| LongLLMLinguaBackbone=Qwen-2-7B2026.02 | 43.55 | 4.95 | 5.92 | 0.75 | |
| LongLLMLinguaBackbone=LLaMA-2-7B2026.02 | 43.01 | 3.47 | 4.82 | 0.86 | |
| Original-ContextBackbone=Qwen-2-7B2026.02 | 40.79 | 4.25 | 1 | 0.41 | |
| 500CompressorBackbone=LLaMA-2-7B2026.02 | 40.28 | 3.38 | 14.58 | 1.23 | |
| Original-ContextBackbone=LLaMA-2-7B2026.02 | 38.72 | 4.09 | 1 | 0.44 | |
| ICAEBackbone=LLaMA-2-7B2026.02 | 38.53 | 3.3 | 14.58 | 1.27 | |
| AutoCompressorBackbone=LLaMA-2-7B2026.02 | 33.98 | 2.47 | 13.94 | 1.26 | |
| Selective-ContextBackbone=Qwen-2-7B2026.02 | 32.38 | 2.55 | 4.12 | 0.66 | |
| Selective-ContextBackbone=LLaMA-2-7B2026.02 | 30.6 | 2.34 | 3.83 | 0.61 | |
| Closed-bookBackbone=Qwen-2-7B2026.02 | 15.52 | 1.01 | — | 2.83 | |
| Closed-bookBackbone=LLaMA-2-7B2026.02 | 10.96 | 0.72 | — | 3.47 |