Video Question Answering on Vript RR benchmark leaderboard · SOTA2 Research

Video Question Answering on Vript RR

0.921Scene Accuracy (M)GPT-4O

Evaluation Results

Method	Links
GPT-4O2024.06		0.921	0.775	0.724	0.546
GPT-4O2024.06		0.914	0.782	0.785	0.66
Gemini-1.5-Pro2024.06		0.851	0.685	0.599	0.475
GPT-4V2024.06		0.809	0.75	0.717	0.61
Claude 3.5-Sonnet2024.06		0.809	0.592	0.546	0.428
VILA-1.52024.06		0.75	0.487	0.553	0.323
Claude 3-Opus2024.06		0.638	0.6052	0.605	0.434
PLLAVA2024.06		0.625	0.461	0.553	0.362
Claude 3-Sonnet2024.06		0.605	0.539	0.566	0.421
VideoChat22024.06		0.52	0.322	0.421	0.224
ST-LLM2024.06		0.434	0.349	0.336	0.263
Video-LLaMA2024.06		0.382	0.197	0.283	0.145
VideoChatGPT2024.06		0.342	0.289	0.296	0.178
VideoChat2024.06		0.336	0.23	0.224	0.151