List your company

Long Video Understanding on LongVideoBench (LongVB)

69.2AccuracyGemini 2.5 Pro
36.33644.86853.461.932Dec 6, 2024Jan 1, 2025Jan 27, 2025Feb 22, 2025Mar 20, 2025Apr 15, 2025May 11, 2025

Evaluation results

MethodLinks
Gemini 2.5 ProEvaluation frame rate=1 FPS, self-collected via API=true2025.0569.2
GPT4-O2024.1266.7
Seed1.5-VLThinking mode=true, Evaluation frame rate=1 FPS2025.0564.6
Gemini 1.5 Pro2024.1264.4
Seed1.5-VLThinking mode=false, Evaluation frame rate=1 FPS2025.0564
GPT4-V2024.1260.7
LinVT-InternVL2Size=8B2024.1257.4
LinVT-Qwen2-VLSize=7B2024.1257.2
LinVT-MolmoSize=7B2024.1256.8
LinVT-BLIP-3Size=4B2024.1256.6
OryxSize=7B2024.1255.3
KangarooSize=8B2024.1254.8
PLLAVASize=34B2024.1253.5
LinVT-AquilaSize=2B2024.1253.5
LinVT-MiphaSize=1.6B2024.1249.7
ShareGPT4VideoSize=8B2024.1241.8
Video-LLaVASize=7B2024.1237.6