Question Answering on AdversarialQA
56.1F1 Scorew/ Context
Evaluation results
| Method | Links | ||
|---|---|---|---|
| w/ ContextCompression Rate=1x2026.02 | 56.1 | 38.67 | |
| PCC-LargeCompression Rate=4x, Parameter Size=8B2026.02 | 52.56 | 39.37 | |
| PCC-LiteCompression Rate=4x, Parameter Size=0.77B2026.02 | 50.36 | 37.83 | |
| OURS (PIC)Compression Rate=4x, Parameter Size=0.5B2026.02 | 50.28 | 38.13 | |
| PCC-LiteCompression Rate=16x, Parameter Size=0.77B2026.02 | 40.94 | 28.07 | |
| OURS (PIC)Compression Rate=16x, Parameter Size=1B2026.02 | 40.53 | 29 | |
| OURS (PIC)Compression Rate=16x, Parameter Size=0.5B2026.02 | 39.98 | 27.73 | |
| PCC-LargeCompression Rate=16x, Parameter Size=8B2026.02 | 38.96 | 26.47 | |
| LLMLingua2Compression Rate=4x, Parameter Size=0.6B2026.02 | 35.41 | 24.8 | |
| OURS (PIC)Compression Rate=64x, Parameter Size=0.5B2026.02 | 29.54 | 19.4 | |
| ICAECompression Rate=4x, Parameter Size=7B2026.02 | 27.98 | 11.7 | |
| PCC-LiteCompression Rate=64x, Parameter Size=0.77B2026.02 | 27.02 | 16.3 | |
| COCOM-LiteCompression Rate=4x, Parameter Size=0.1B2026.02 | 19.45 | 13.9 | |
| COCOM-LiteCompression Rate=16x, Parameter Size=0.1B2026.02 | 19.45 | 13.9 | |
| AutoCompressorCompression Rate=40x2026.02 | 14.09 | 2 | |
| xRAGCompression Rate=> 64x2026.02 | 13.75 | 3.47 | |
| w/o ContextCompression Rate=1x2026.02 | 12.05 | 6.43 |