List your company
ResearchFormerly WizWand

Question Answering on In-Domain Average (EM, F1)

53.52EMSeCo
24.483232.021639.5647.0984May 10, 2026
Updated 5mo ago

Evaluation results

MethodLinks
SeCoBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.0553.5268.55
SeCoBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.0552.3567.12
SeCoBackbone=Qwen3-4B-Instruct, Compression constraint=16x2026.0549.6565.84
SeCoBackbone=Qwen3-4B-Instruct, Compression constraint=32x2026.0549.0664.67
500x (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=16x2026.0545.8262.04
SAC (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=16x2026.0545.0361.3
COMIBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.0542.0754.37
ICAE (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=16x2026.0541.5957.2
500x (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=32x2026.0541.0356.05
SAC (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=32x2026.0540.8256.07
500x (DPL)Backbone=Qwen3-4B-Instruct, Compression constraint=16x2026.0539.9955.03
500x (DPL)Backbone=Qwen3-4B-Instruct, Compression constraint=32x2026.0539.6154.52
RAMBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.0536.9951.03
COMIBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.0536.6448.52
ICAE (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=32x2026.053651.41
RAMBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.0533.3346.32
500x (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.0532.7247.46
SAC (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.0532.5647.38
500x (DPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.0530.8944.46
ICAE (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.0529.8944.24
SAC (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.0529.7843.52
RAMBackbone=Qwen3-4B-Instruct, Compression constraint=16x2026.0528.9638.75
500x (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.0528.8642.34
500x (DPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.0528.8141.69
ICAE (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.0528.6642.36
COMIBackbone=Qwen3-4B-Instruct, Compression constraint=16x2026.0528.5238.39
COMIBackbone=Qwen3-4B-Instruct, Compression constraint=32x2026.0525.8234.7
RAMBackbone=Qwen3-4B-Instruct, Compression constraint=32x2026.0525.634.42