List your company
ResearchFormerly WizWand

Knowledge-based Visual Question Answering on OKVQA (val)

66.7AccuracySMoLA-PaLI-X_FT (Specialist)
-1.00416.57334.1551.727Sep 5, 2023Jan 26, 2024Jun 18, 2024Nov 9, 2024Apr 2, 2025Aug 24, 2025Jan 15, 2026
Updated 8mo ago

Evaluation results

MethodLinks
SMoLA-PaLI-X_FT (Specialist)Base model=PaLI-X, Per-task LoRA tuning=true, LoRA rank=42023.1266.7
PaLM-ECategory=Specialist2023.1266.1
PaLI-XCategory=Specialist2023.1266.1
PaLI-XBase model=PaLI-X2023.1266.1
SOTA [7]2023.1266.1
CogVLMCategory=Specialist2023.1264.7
SMOLA-PALI-XFTCategory=Generalist, Fine-tuned=true2023.1262.4
PaLI-XFTCategory=Generalist, Fine-tuned=true2023.1260.7
LLaVA-OV-7B w/ CLIModel=LLaVA-OV-7B w/ CLI2026.0159.2
CogVLMCategory=Generalist2023.1258.9
Qwen-VLCategory=Generalist2023.1258.6
LLaVA-OV-7BModel=LLaVA-OV-7B2026.0158.5
LLaVA-OV-7B w/ SLIModel=LLaVA-OV-7B w/ SLI2026.0158.4
LLaVA-OV-7B w/ DeepStackModel=LLaVA-OV-7B w/ DeepStack2026.0158.3
SMOLA48-PaLI-3FTCategory=Generalist, Fine-tuned=true2023.1258.2
PaLI-3FTCategory=Generalist, Fine-tuned=true2023.1256.2
Unified-IOCategory=Generalist2023.1254
InternVL-2-8BModel=InternVL-2-8B2026.0152.1
LLaVA-OV-0.5B w/ SLIModel=LLaVA-OV-0.5B w/ SLI2026.0148.8
LLaVA-OV-0.5B w/ CLIModel=LLaVA-OV-0.5B w/ CLI2026.0148.6
LLaVA-OV-0.5BModel=LLaVA-OV-0.5B2026.0148.4
InternVL-2-26BModel=InternVL-2-26B2026.0148.3
LLaVA-OV-0.5B w/ DeepStackModel=LLaVA-OV-0.5B w/ DeepStack2026.0146.2
Flamingo-9Bshots=0-shot2023.0944.7
IXC-2.5-7BModel=IXC-2.5-7B2026.0129.2
SFT-CM3Leon-7Bshots=0-shot, SFT=true2023.0923.8
VILA-13BModel=VILA-13B2026.011.6