List your company
ResearchFormerly WizWand

Question Answering on PopQA (str-em accuracy @5, @10)

51.75Strict EM Accuracy @5DCCD
17.107626.101335.09544.0887Jul 1, 2026
Updated 4mo ago

Evaluation results

MethodLinks
DCCDModel=Qwen3.5-2B2026.0751.7553.34
DCCDModel=Qwen3.5-9B2026.0751.4253.29
DCCDModel=Phi-3-medium (14B)2026.0751.3952.14
fullModel=Qwen3.5-2B2026.0751.3553.32
CADModel=Qwen3.5-2B2026.0751.352.61
COCOAModel=Qwen3.5-9B2026.0751.1652.21
ADACADModel=Qwen3.5-2B2026.0751.1152.57
fullModel=Qwen3.5-9B2026.0750.9352.1
ADACADModel=Phi-3-medium (14B)2026.0750.9351.56
fullModel=Phi-3-medium (14B)2026.0750.951.86
CADModel=Phi-3-medium (14B)2026.0750.7451.68
COCOAModel=Phi-3-medium (14B)2026.0750.7151.16
CADModel=Qwen3.5-9B2026.0750.5751.56
ADACADModel=Qwen3.5-9B2026.0750.551.49
DVDModel=Qwen3.5-2B2026.0750.4152.31
DVDModel=Qwen3.5-9B2026.0750.3650.6
DVDModel=Phi-3-medium (14B)2026.0750.1850.39
COCOAModel=Qwen3.5-2B2026.0749.2949.94
zero-shotModel=Phi-3-medium (14B)2026.0737.22—
zero-shotModel=Qwen3.5-9B2026.0726.06—
zero-shotModel=Qwen3.5-2B2026.0718.44—