Visual Question Answering on VQA 10,000 samples v2 (val)
74.66Accuracy (VQA)HiFICL
Evaluation Results
| Method | Links | |
|---|---|---|
| HiFICLModel=LLaVA, # Params (M)=2.2 (×1.0)2026.03 | 74.66 | |
| MimICModel=LLaVA, # Params (M)=17.0 (×7.7)2026.03 | 74.4 | |
| LIVEModel=LLaVA, # Params (M)=0.13 (×0.05)2026.03 | 74.17 | |
| HiFICLModel=Idefics2, # Params (M)=2.2 (×1.0)2026.03 | 72.08 | |
| Hyper-ICLModel=Idefics2-8b, Method Type=Learnable, # Params (M)=1.18 (×1)2026.06 | 71.17 | |
| LoRAModel=LLaVA, # Params (M)=19.7 (×8.95)2026.03 | 70.12 | |
| MimICModel=Idefics2, # Params (M)=0.26 (×0.12)2026.03 | 69.29 | |
| MimICModel=Idefics2-8b, Method Type=Learnable, # Params (M)=0.26 (×0.22)2026.06 | 69.29 | |
| LoRAModel=Idefics2, # Params (M)=17.6 (×8.0)2026.03 | 69.14 | |
| 8-shot ICLModel=LLaVA, # Params (M)=-2026.03 | 68.19 | |
| LIVEModel=Idefics2, # Params (M)=0.13 (×0.06)2026.03 | 67.6 | |
| LIVEModel=Idefics2-8b, Method Type=Learnable, # Params (M)=0.13 (×0.11)2026.06 | 67.6 | |
| LoRAModel=Idefics2-8b, Method Type=Learnable, # Params (M)=17.6 (×14.9)2026.06 | 66.54 | |
| RICESModel=Idefics2-8b, Method Type=Direct ICDs2026.06 | 66.44 | |
| 8-shot ICLModel=Idefics2, # Params (M)=-2026.03 | 66.2 | |
| 8-shot ICLModel=Idefics2-8b, Method Type=Direct ICDs2026.06 | 66.2 | |
| Hyper-ICLModel=Idefics-9b, Method Type=Learnable, # Params (M)=1.18 (×1)2026.06 | 62.08 | |
| MimICModel=Idefics-9b, Method Type=Learnable, # Params (M)=0.26 (×0.22)2026.06 | 59.64 | |
| RICESModel=Idefics-9b, Method Type=Direct ICDs2026.06 | 58.07 | |
| 32-shot ICLModel=Idefics-9b, Method Type=Direct ICDs2026.06 | 56.18 | |
| LoRAModel=Idefics-9b, Method Type=Learnable, # Params (M)=25.0 (×21.2)2026.06 | 55.6 | |
| Zero-shotModel=Idefics2, # Params (M)=-2026.03 | 55.39 | |
| Zero-shotModel=Idefics2-8b, Method Type=Direct ICDs2026.06 | 55.39 | |
| LIVEModel=Idefics-9b, Method Type=Learnable, # Params (M)=0.13 (×0.11)2026.06 | 53.71 | |
| TVModel=Idefics2-8b, Method Type=Non-Learnable2026.06 | 47.12 | |
| TVModel=Idefics-9b, Method Type=Non-Learnable2026.06 | 43.68 | |
| FVModel=Idefics2-8b, Method Type=Non-Learnable2026.06 | 36.47 | |
| FVModel=Idefics-9b, Method Type=Non-Learnable2026.06 | 30.21 | |
| Zero-shotModel=Idefics-9b, Method Type=Direct ICDs2026.06 | 29.25 | |
| Zero-shotModel=LLaVA, # Params (M)=-2026.03 | 13.02 |