List your company
ResearchFormerly WizWand

Reading Comprehension on RACE (EM, F1)

23.29EMSeCo
0.60766.496312.38518.2737May 10, 2026
Updated 5mo ago

Evaluation results

MethodLinks
SeCoBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.0523.2939.98
SeCoBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.052340.04
RAMBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.0513.525.33
RAMBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.0512.9123.6
COMIBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.059.3519.37
COMIBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.057.2716.56
SAC (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.053.7118.78
500x (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.053.4118.9
SAC (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.053.1215.75
500x (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.052.9715.49
ICAE (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.052.9714.81
500x (DPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.052.5214.16
ICAE (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.052.0814.54
500x (DPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.051.4811.96