List your company
ResearchFormerly WizWand

Visual Question Answering on VQA 10,000 samples v2 (val)

74.66Accuracy (VQA)HiFICL
10.554427.197243.8460.4828Mar 13, 2026Mar 26, 2026Apr 9, 2026Apr 23, 2026May 6, 2026May 20, 2026Jun 3, 2026
Updated 5mo ago

Evaluation results

MethodLinks
HiFICLModel=LLaVA, # Params (M)=2.2 (×1.0)2026.0374.66
MimICModel=LLaVA, # Params (M)=17.0 (×7.7)2026.0374.4
LIVEModel=LLaVA, # Params (M)=0.13 (×0.05)2026.0374.17
HiFICLModel=Idefics2, # Params (M)=2.2 (×1.0)2026.0372.08
Hyper-ICLModel=Idefics2-8b, Method Type=Learnable, # Params (M)=1.18 (×1)2026.0671.17
LoRAModel=LLaVA, # Params (M)=19.7 (×8.95)2026.0370.12
MimICModel=Idefics2, # Params (M)=0.26 (×0.12)2026.0369.29
MimICModel=Idefics2-8b, Method Type=Learnable, # Params (M)=0.26 (×0.22)2026.0669.29
LoRAModel=Idefics2, # Params (M)=17.6 (×8.0)2026.0369.14
8-shot ICLModel=LLaVA, # Params (M)=-2026.0368.19
LIVEModel=Idefics2, # Params (M)=0.13 (×0.06)2026.0367.6
LIVEModel=Idefics2-8b, Method Type=Learnable, # Params (M)=0.13 (×0.11)2026.0667.6
LoRAModel=Idefics2-8b, Method Type=Learnable, # Params (M)=17.6 (×14.9)2026.0666.54
RICESModel=Idefics2-8b, Method Type=Direct ICDs2026.0666.44
8-shot ICLModel=Idefics2, # Params (M)=-2026.0366.2
8-shot ICLModel=Idefics2-8b, Method Type=Direct ICDs2026.0666.2
Hyper-ICLModel=Idefics-9b, Method Type=Learnable, # Params (M)=1.18 (×1)2026.0662.08
MimICModel=Idefics-9b, Method Type=Learnable, # Params (M)=0.26 (×0.22)2026.0659.64
RICESModel=Idefics-9b, Method Type=Direct ICDs2026.0658.07
32-shot ICLModel=Idefics-9b, Method Type=Direct ICDs2026.0656.18
LoRAModel=Idefics-9b, Method Type=Learnable, # Params (M)=25.0 (×21.2)2026.0655.6
Zero-shotModel=Idefics2, # Params (M)=-2026.0355.39
Zero-shotModel=Idefics2-8b, Method Type=Direct ICDs2026.0655.39
LIVEModel=Idefics-9b, Method Type=Learnable, # Params (M)=0.13 (×0.11)2026.0653.71
TVModel=Idefics2-8b, Method Type=Non-Learnable2026.0647.12
TVModel=Idefics-9b, Method Type=Non-Learnable2026.0643.68
FVModel=Idefics2-8b, Method Type=Non-Learnable2026.0636.47
FVModel=Idefics-9b, Method Type=Non-Learnable2026.0630.21
Zero-shotModel=Idefics-9b, Method Type=Direct ICDs2026.0629.25
Zero-shotModel=LLaVA, # Params (M)=-2026.0313.02