List your company
ResearchFormerly WizWand

Question Answering on SearchQA

78EMComprExIT
-1.14419.40339.9560.497Feb 3, 2026Feb 19, 2026Mar 7, 2026Mar 23, 2026Apr 8, 2026Apr 24, 2026May 10, 2026
Updated 5mo ago

Evaluation results

MethodLinks
ComprExITBackbone=Llama-3.2-3B-Base, Evaluation Protocol=Context Compression2026.027884.4
ICAEBackbone=Llama-3.2-3B-Base, Evaluation Protocol=Context Compression2026.0276.4382.89
Prompt tuningBackbone=Llama-3.2-3B-Base, Evaluation Protocol=Prompt tuning, Context Setting=w/ context2026.0272.0478.42
ComprExITBackbone=Llama-3.2-1B-Base, Evaluation Protocol=Context Compression2026.0271.9178.93
SeCoBackbone=Qwen3-4B-Instruct, Compression constraint=16x2026.0569.7778.22
500xBackbone=Llama-3.2-3B-Base, Evaluation Protocol=Context Compression2026.0269.2676.28
SeCoBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.0568.676.66
SeCoBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.056875.67
ICAEBackbone=Llama-3.2-1B-Base, Evaluation Protocol=Context Compression2026.0267.474.43
SeCoBackbone=Qwen3-4B-Instruct, Compression constraint=32x2026.0567.2975.59
Prompt tuningBackbone=Llama-3.2-1B-Base, Evaluation Protocol=Prompt tuning, Context Setting=w/ context2026.0264.0370.64
COMIBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.0562.8870.65
500x (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=16x2026.0559.4571.93
COMIBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.0559.0566.69
500x (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=32x2026.0558.2870.56
500x (DPL)Backbone=Qwen3-4B-Instruct, Compression constraint=32x2026.0556.6571.69
SAC (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=16x2026.0556.569.66
SAC (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=32x2026.0556.4169.45
500x (DPL)Backbone=Qwen3-4B-Instruct, Compression constraint=16x2026.0555.9169.28
ICAE (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=16x2026.0553.5666.95
RAMBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.0551.4761.69
RAMBackbone=Qwen3-4B-Instruct, Compression constraint=16x2026.0549.8356.26
COMIBackbone=Qwen3-4B-Instruct, Compression constraint=16x2026.0549.2755.96
500x (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.0548.4962.25
SAC (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.0547.6661.47
500x (DPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.0547.3461
RAMBackbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.0546.856.83
SAC (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.0546.7360.56
500x (DPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.0546.6359.93
COMIBackbone=Qwen3-4B-Instruct, Compression constraint=32x2026.0546.552.61
ICAE (EPL)Backbone=Qwen3-4B-Instruct, Compression constraint=32x2026.0546.460.19
RAMBackbone=Qwen3-4B-Instruct, Compression constraint=32x2026.0546.1352.36
500x (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.0544.7558.16
ICAE (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=16x2026.0544.1757.67
ICAE (EPL)Backbone=LLaMA-3.2-1B-Instruct, Compression constraint=32x2026.0544.1358.21
DOPAModel=Qwen3-1.7B2026.0440.9552.56
KNNModel=Qwen3-1.7B2026.0439.3551.96
DOPAModel=LLaMA3.2-3B2026.0434.553.72
KNNModel=LLaMA3.2-3B2026.0433.152.46
Zero-shotBackbone=Llama-3.2-3B-Base, Evaluation Protocol=Zero-shot, Context Setting=w/ context2026.0229.437.26
Zero-shotBackbone=Llama-3.2-3B-Base, Evaluation Protocol=Zero-shot, Context Setting=w/o context2026.0225.4330.35
500xBackbone=Llama-3.2-1B-Base, Evaluation Protocol=Context Compression2026.0217.4425.59
Zero-shotBackbone=Llama-3.2-1B-Base, Evaluation Protocol=Zero-shot, Context Setting=w/ context2026.025.8312.39
BeaconBackbone=Llama-3.2-3B-Base, Evaluation Protocol=Context Compression2026.025.249.13
Zero-shotBackbone=Llama-3.2-1B-Base, Evaluation Protocol=Zero-shot, Context Setting=w/o context2026.024.046.64
BeaconBackbone=Llama-3.2-1B-Base, Evaluation Protocol=Context Compression2026.021.99.86