Prompt Compression on MMLU
49.2MMLU Accuracy (Chemistry)Oracle Exp.
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Oracle Exp.2025.05 | 49.2 | 50.2 | 72.8 | 72.8 | 57 | |
| Proxy Exp.2025.05 | 41 | 43 | 67.6 | 69.8 | 52 | |
| LLMLingua2025.05 | 38.7 | 38.3 | 62.5 | 66.1 | 46.3 | |
| AttnComp2025.05 | 34.5 | 39.1 | 63.2 | 66.5 | 47.1 | |
| Random2025.05 | 29 | 35.6 | 59.8 | 61 | 43.4 |