List your company
ResearchFormerly WizWand

Visual Question Answering on OVEN Query 1.0 (test)

30.9HMGiT-Large
0.4288.33916.2524.161Oct 31, 2024
Updated 8mo ago

Evaluation results

MethodLinks
GiT-Large#par (B)=0.4, Training Dataset=REW-47M (Ours), Evaluation Protocol=+ seen finetune2024.1030.939.225.5
GiT-Large#par (B)=0.4, Training Dataset=REW-47M (Ours), Evaluation Protocol=Zero-shot2024.103031.228.9
PaLI-17B#par (B)=17, Training Dataset=WebLI-1B [9], Evaluation Protocol=+ seen finetune2024.1027.136.221.7
PaLI-3B#par (B)=3, Training Dataset=WebLI-1B [9], Evaluation Protocol=+ seen finetune2024.1016.727.412
GiT-Large#par (B)=0.4, Training Dataset=WebLI-100M [9], Evaluation Protocol=+ seen finetune2024.1015.628.910.7
GiT-Large#par (B)=0.4, Training Dataset=Entity-WebLI [7], Evaluation Protocol=Zero-shot2024.1010.49.811
GiT-Large#par (B)=0.4, Training Dataset=Entity-WebLI [7], Evaluation Protocol=+ seen finetune2024.1010.117.77.1
PaLI-17B#par (B)=17, Training Dataset=WebLI-1B [9], Evaluation Protocol=Zero-shot2024.109.214.16.8
GER-ALD#par (B)=0.4, Training Dataset=Entity-WebLI [7], Evaluation Protocol=Zero-shot2024.106.366.7
GER-ALD#par (B)=0.4, Training Dataset=Entity-WebLI [7], Evaluation Protocol=+ seen finetune2024.105.814.13.6
GiT-Large#par (B)=0.4, Training Dataset=WebLI-100M [9], Evaluation Protocol=Zero-shot2024.103.95.13.2
CLIP2CLIP#par (B)=0.9, Training Dataset=OpenAI [41], Evaluation Protocol=+ seen finetune2024.103.53.83.2
CLIPfusion#par (B)=0.9, Training Dataset=OpenAI [41], Evaluation Protocol=+ seen finetune2024.102.725.81.4
CLIPfusion#par (B)=0.9, Training Dataset=OpenAI [41], Evaluation Protocol=Zero-shot2024.101.61.32
CLIP2CLIP#par (B)=0.9, Training Dataset=OpenAI [41], Evaluation Protocol=Zero-shot2024.101.61.32