Question Answering on TQA (EM, F1)
42.12EMSeCo
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SeCoBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.05 | 42.12 | 53.48 | |
| SeCoBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.05 | 41.78 | 52.67 | |
| 500x (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.05 | 24.75 | 41.1 | |
| SAC (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.05 | 23.35 | 39.34 | |
| RAMBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.05 | 22.09 | 29.26 | |
| SAC (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.05 | 21.62 | 37.18 | |
| 500x (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.05 | 21.29 | 35.8 | |
| RAMBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.05 | 20.63 | 28.37 | |
| ICAE (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.05 | 19.49 | 32.57 | |
| ICAE (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.05 | 18.5 | 30.76 | |
| 500x (DPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.05 | 17.43 | 30.78 | |
| COMIBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.05 | 16.5 | 24.92 | |
| 500x (DPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.05 | 16.43 | 28.16 | |
| COMIBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.05 | 15.17 | 22.55 |