Question Answering on 24K Long-Context QA Tasks
17.75MultiFieldQA ScoreSAC
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SACContext Length=24K, Compression Ratio=15x2025.10 | 17.75 | 11.33 | 11.67 | 13.58 | 24.78 | 12.36 | 26.03 | 21.06 | |
| SACMethod Variant=ae+lm, Context Length=24K, Compression Ratio=15x2025.10 | 17.38 | 10.49 | 9.05 | 12.31 | 22.47 | 7.76 | 23.88 | 18.04 | |
| EPLContext Length=24K, Compression Ratio=15x2025.10 | 14.34 | 10.5 | 7.58 | 10.81 | 21.99 | 8.43 | 23.72 | 18.05 |