List your company

Video Understanding on VideoMME w/ sub (Accuracy)

81.3AccuracyGemini 1.5 Pro
46.9855.8964.873.71May 19, 2026

Evaluation results

MethodLinks
Gemini 1.5 ProSetting=best-setting numbers from official reports2026.0581.3
GPT-4oSetting=best-setting numbers from official reports2026.0577.2
ParaVT-8BSetting=tool-augmented setting (<think>→<tool_call>→<answer>)2026.0569.4
Qwen3-VL-8BSetting=tool-augmented setting (<think>→<tool_call>→<answer>)2026.0568.4
Time-R1-7BSetting=reasoning-enhanced setting (<think>→<answer>)2026.0566.2
Video-R1-7BSetting=reasoning-enhanced setting (<think>→<answer>)2026.0566
LongVT-RFT-7BSetting=tool-augmented setting (<think>→<tool_call>→<answer>)2026.0566
VideoRFT-7BSetting=reasoning-enhanced setting (<think>→<answer>)2026.0565.6
Video-Thinker-7BSetting=reasoning-enhanced setting (<think>→<answer>)2026.0565.3
ReWatch-R1-7BSetting=reasoning-enhanced setting (<think>→<answer>)2026.0565
Qwen2.5-VL-7BSetting=direct-answer setting (native single-pass prompt)2026.0564.5
Conan-7BSetting=tool-augmented setting (<think>→<tool_call>→<answer>)2026.0562.8
VideoChat-R1-7BSetting=reasoning-enhanced setting (<think>→<answer>)2026.0558.2
SAGE-7BSetting=tool-augmented setting (<think>→<tool_call>→<answer>)2026.0552.4
VideoZoomer-7BSetting=tool-augmented setting (<think>→<tool_call>→<answer>)2026.0548.3