List your company
ResearchFormerly WizWand

Grounded Video Question Answering on DeVE-QA 1.0 (test)

0.582mIoPHuman
0.19720.29710.3970.4969Sep 6, 2024
Updated 8mo ago

Evaluation results

MethodLinks
Humanmode=Oracle2024.090.5820.6230.4390.5270.8470.624
DeVi-Gemini-2.0Supervision=Zero-shot, Backbone=Gemini-2.02024.090.3490.3280.2170.1850.7210.277
DeVi-GPT-4oSupervision=Zero-shot, Backbone=GPT-4o2024.090.3380.3220.2070.1740.7190.271
LLoViSupervision=Zero-shot2024.090.2750.270.1790.130.6390.229
SeViLASupervision=Weakly-supervised, Pre-training=video grounding datasets2024.090.2580.1990.2120.1150.6270.161
LongVASupervision=Zero-shot2024.090.2490.2470.1690.1520.6620.208
Temp[CLIP](NG+)Supervision=Weakly-supervised2024.090.2460.2480.1250.0910.5890.149
VideoLLaMA2Supervision=Zero-shot2024.090.2370.220.1290.1010.620.192
Qwen2-VLSupervision=Zero-shot2024.090.2360.2320.1650.1470.6390.201
VideoChat2Supervision=Zero-shot2024.090.2310.2180.1420.1250.5920.186
LLaVA-Next-VideoSupervision=Zero-shot2024.090.2250.2110.1380.1070.5690.174
FrozenBiLM(NG+)Supervision=Weakly-supervised2024.090.2120.1820.0850.0620.6160.145