Context Compression on HotpotQA (val)
1.6TFLOPs (Read)RECOMP-Abst
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RECOMP-AbstGPU=A100-80GB2024.12 | 1.6 | 0.54 | 2.31 | 0.41 | |
| RECOMP-ExtrGPU=A100-80GB2024.12 | 1.84 | 0.27 | 0.39 | 2.43 | |
| CompActGPU=A100-80GB2024.12 | 2.05 | 18.35 | 12.86 | 0.07 | |
| RefinerGPU=A100-80GB2024.12 | 2.51 | 15.03 | 6.78 | 0.14 | |
| EXITGPU=A100-80GB2024.12 | 2.96 | 35.44 | 0.88 | 1.08 | |
| LongLLMLinguaGPU=A100-80GB2024.12 | 5.06 | 46.39 | 0.82 | 1.16 | |
| Original DocsGPU=A100-80GB2024.12 | 13.04 | — | 0.95 | 1 |