# Video Question Answering on Vript-ERO (VERO) Source: [Video Question Answering on Vript-ERO (VERO)]() Collection index: [llms.txt]() Data updated: 2026-04-28T10:07:09.953Z Evaluation of model performance on the Vript-ERO (VERO) dataset for the Video Question Answering task. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Video Question Answering | | Dataset (including any stated split) | Vript-ERO (VERO) | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | Omni-o3 | 40.3 | Not recorded | 69f03f6f55a3c32af89fa470 | | Qwen3-VL | 39.6 | Not recorded | 69f03f6f55a3c32af89fa470 | | GPT-4o | 38.6 | Not recorded | 69f03f6f55a3c32af89fa470 | | Qwen3-Omni | 38.1 | Not recorded | 69f03f6f55a3c32af89fa470 | | AVATAR | 36.6 | Not recorded | 69f03f6f55a3c32af89fa470 | | VideoChat-R1 | 35.1 | Not recorded | 69f03f6f55a3c32af89fa470 | | Open-o3-video | 32.8 | Not recorded | 69f03f6f55a3c32af89fa470 | | Qwen2.5-Omni | 32.1 | Not recorded | 69f03f6f55a3c32af89fa470 | | VideoRFT | 30.6 | Not recorded | 69f03f6f55a3c32af89fa470 | | Ola | 29.1 | Not recorded | 69f03f6f55a3c32af89fa470 | | AV-Reasoner | 28.4 | Not recorded | 69f03f6f55a3c32af89fa470 | | Qwen2.5-VL | 25.4 | Not recorded | 69f03f6f55a3c32af89fa470 | | Omni-R1 | 24.6 | Not recorded | 69f03f6f55a3c32af89fa470 | | EchoInk-R1 | 23.9 | Not recorded | 69f03f6f55a3c32af89fa470 | | HumanOmniV2 | 23.9 | Not recorded | 69f03f6f55a3c32af89fa470 | | Gemini1.5Pro | 9.1 | Not recorded | 69f03f6f55a3c32af89fa470 | ### Omni-o3 Accuracy: 40.3. Result ID: 69f086bb47f34ce924d70318. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs"}. This record does not assert independent reproduction. ### Qwen3-VL Accuracy: 39.6. Result ID: 69f086bb47f34ce924d7030c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Video MLLMs","Release Date":"Oct 25"}. This record does not assert independent reproduction. ### GPT-4o Accuracy: 38.6. Result ID: 69f086bb47f34ce924d70309. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Category":"Closed-Source APIs","Release Date":"May 24"}. This record does not assert independent reproduction. ### Qwen3-Omni Accuracy: 38.1. Result ID: 69f086bb47f34ce924d70311. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs","Release Date":"Sep 25"}. This record does not assert independent reproduction. ### AVATAR Accuracy: 36.6. Result ID: 69f086bb47f34ce924d70317. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs","Release Date":"CVPR 26"}. This record does not assert independent reproduction. ### VideoChat-R1 Accuracy: 35.1. Result ID: 69f086bb47f34ce924d7030f. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Video MLLMs","Release Date":"Apr 25"}. This record does not assert independent reproduction. ### Open-o3-video Accuracy: 32.8. Result ID: 69f086bb47f34ce924d7030d. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Video MLLMs","Release Date":"Oct 25"}. This record does not assert independent reproduction. ### Qwen2.5-Omni Accuracy: 32.1. Result ID: 69f086bb47f34ce924d70310. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs","Release Date":"Mar 25"}. This record does not assert independent reproduction. ### VideoRFT Accuracy: 30.6. Result ID: 69f086bb47f34ce924d7030e. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Video MLLMs","Release Date":"May 25"}. This record does not assert independent reproduction. ### Ola Accuracy: 29.1. Result ID: 69f086bb47f34ce924d70312. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs","Release Date":"Feb 25"}. This record does not assert independent reproduction. ### AV-Reasoner Accuracy: 28.4. Result ID: 69f086bb47f34ce924d70315. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs","Release Date":"June 25"}. This record does not assert independent reproduction. ### Qwen2.5-VL Accuracy: 25.4. Result ID: 69f086bb47f34ce924d7030b. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Video MLLMs","Release Date":"Feb 25"}. This record does not assert independent reproduction. ### Omni-R1 Accuracy: 24.6. Result ID: 69f086bb47f34ce924d70314. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs","Release Date":"May 25"}. This record does not assert independent reproduction. ### EchoInk-R1 Accuracy: 23.9. Result ID: 69f086bb47f34ce924d70313. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs","Release Date":"May 25"}. This record does not assert independent reproduction. ### HumanOmniV2 Accuracy: 23.9. Result ID: 69f086bb47f34ce924d70316. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs","Release Date":"June 25"}. This record does not assert independent reproduction. ### Gemini1.5Pro Accuracy: 9.1. Result ID: 69f086bb47f34ce924d7030a. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Closed-Source APIs","Release Date":"Dec 24"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.