Long-context language understanding on LongBench Zh out-of-domain
61.2SingleDoc AccOriginal Prompt
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Original PromptTokens=14,9402024.03 | 61.2 | 28.7 | 16 | 29.2 | 77.5 | 42.5 | |
| LLMLingua-2Type=Task(Question)-Agnostic Compression, Tokens=3,023, Compression ratio (1/τ)=5x2024.03 | 46.7 | 23 | 15.3 | 32.8 | 72.6 | 38.1 | |
| LLMLinguaType=Task(Question)-Agnostic Compression, Tokens=3,060, Compression ratio (1/τ)=5x2024.03 | 35.2 | 20.4 | 11.8 | 24.3 | 51.4 | 28.6 |