Question Answering on In-Domain Average (EM, F1)
53.52EMSeCo
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SeCoBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.05 | 53.52 | 68.55 | |
| SeCoBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.05 | 52.35 | 67.12 | |
| SeCoBackbone=Qwen3-4B-Instruct, Compression constraint=16x2026.05 | 49.65 | 65.84 | |
| SeCoBackbone=Qwen3-4B-Instruct, Compression constraint=32x2026.05 | 49.06 | 64.67 | |
| 500x (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=16x2026.05 | 45.82 | 62.04 | |
| SAC (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=16x2026.05 | 45.03 | 61.3 | |
| COMIBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.05 | 42.07 | 54.37 | |
| ICAE (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=16x2026.05 | 41.59 | 57.2 | |
| 500x (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=32x2026.05 | 41.03 | 56.05 | |
| SAC (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=32x2026.05 | 40.82 | 56.07 | |
| 500x (DPL)Backbone=Qwen3-4B-Instruct, Compression constraint=16x2026.05 | 39.99 | 55.03 | |
| 500x (DPL)Backbone=Qwen3-4B-Instruct, Compression constraint=32x2026.05 | 39.61 | 54.52 | |
| RAMBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.05 | 36.99 | 51.03 | |
| COMIBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.05 | 36.64 | 48.52 | |
| ICAE (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=32x2026.05 | 36 | 51.41 | |
| RAMBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.05 | 33.33 | 46.32 | |
| 500x (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.05 | 32.72 | 47.46 | |
| SAC (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.05 | 32.56 | 47.38 | |
| 500x (DPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.05 | 30.89 | 44.46 | |
| ICAE (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.05 | 29.89 | 44.24 | |
| SAC (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.05 | 29.78 | 43.52 | |
| RAMBackbone=Qwen3-4B-Instruct, Compression constraint=16x2026.05 | 28.96 | 38.75 | |
| 500x (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.05 | 28.86 | 42.34 | |
| 500x (DPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.05 | 28.81 | 41.69 | |
| ICAE (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.05 | 28.66 | 42.36 | |
| COMIBackbone=Qwen3-4B-Instruct, Compression constraint=16x2026.05 | 28.52 | 38.39 | |
| COMIBackbone=Qwen3-4B-Instruct, Compression constraint=32x2026.05 | 25.82 | 34.7 | |
| RAMBackbone=Qwen3-4B-Instruct, Compression constraint=32x2026.05 | 25.6 | 34.42 |