Video Question Answering on Vript-ERO (VERO)
40.3AccuracyOmni-o3
Evaluation results
| Method | Links | |
|---|---|---|
| Omni-o3Model Category=Omnimodal MLLMs2026.04 | 40.3 | |
| Qwen3-VLModel Category=Video MLLMs, Release Date=Oct 252026.04 | 39.6 | |
| GPT-4oModel Category=Closed-Source APIs, Release Date=May 242026.04 | 38.6 | |
| Qwen3-OmniModel Category=Omnimodal MLLMs, Release Date=Sep 252026.04 | 38.1 | |
| AVATARModel Category=Omnimodal MLLMs, Release Date=CVPR 262026.04 | 36.6 | |
| VideoChat-R1Model Category=Video MLLMs, Release Date=Apr 252026.04 | 35.1 | |
| Open-o3-videoModel Category=Video MLLMs, Release Date=Oct 252026.04 | 32.8 | |
| Qwen2.5-OmniModel Category=Omnimodal MLLMs, Release Date=Mar 252026.04 | 32.1 | |
| VideoRFTModel Category=Video MLLMs, Release Date=May 252026.04 | 30.6 | |
| OlaModel Category=Omnimodal MLLMs, Release Date=Feb 252026.04 | 29.1 | |
| AV-ReasonerModel Category=Omnimodal MLLMs, Release Date=June 252026.04 | 28.4 | |
| Qwen2.5-VLModel Category=Video MLLMs, Release Date=Feb 252026.04 | 25.4 | |
| Omni-R1Model Category=Omnimodal MLLMs, Release Date=May 252026.04 | 24.6 | |
| EchoInk-R1Model Category=Omnimodal MLLMs, Release Date=May 252026.04 | 23.9 | |
| HumanOmniV2Model Category=Omnimodal MLLMs, Release Date=June 252026.04 | 23.9 | |
| Gemini1.5ProModel Category=Closed-Source APIs, Release Date=Dec 242026.04 | 9.1 |