# Video Question Answering on Vript-RR (VRR) Source: [Video Question Answering on Vript-RR (VRR)]() Collection index: [llms.txt]() Data updated: 2026-04-28T10:07:09.922Z Evaluation of model performance on the Vript-RR (VRR) dataset for the Video Question Answering task, reporting the overall average score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Video Question Answering | | Dataset (including any stated split) | Vript-RR (VRR) | | Metric | Average Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Average Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Average Score | Result date | Report paper | | --- | --- | --- | --- | | GPT-4o | 85.3 | Not recorded | 69f03f6f55a3c32af89fa470 | | Qwen3-Omni | 80.6 | Not recorded | 69f03f6f55a3c32af89fa470 | | Omni-o3 | 79.7 | Not recorded | 69f03f6f55a3c32af89fa470 | | Qwen3-VL | 79 | Not recorded | 69f03f6f55a3c32af89fa470 | | VideoRFT | 77.7 | Not recorded | 69f03f6f55a3c32af89fa470 | | Ola | 76 | Not recorded | 69f03f6f55a3c32af89fa470 | | AVATAR | 75.7 | Not recorded | 69f03f6f55a3c32af89fa470 | | HumanOmniV2 | 74.8 | Not recorded | 69f03f6f55a3c32af89fa470 | | Qwen2.5-VL | 74.7 | Not recorded | 69f03f6f55a3c32af89fa470 | | Open-o3-video | 74.3 | Not recorded | 69f03f6f55a3c32af89fa470 | | EchoInk-R1 | 73.1 | Not recorded | 69f03f6f55a3c32af89fa470 | | VideoChat-R1 | 72.7 | Not recorded | 69f03f6f55a3c32af89fa470 | | AV-Reasoner | 72.7 | Not recorded | 69f03f6f55a3c32af89fa470 | | Gemini1.5Pro | 72.5 | Not recorded | 69f03f6f55a3c32af89fa470 | | Qwen2.5-Omni | 72.4 | Not recorded | 69f03f6f55a3c32af89fa470 | | Omni-R1 | 68.1 | Not recorded | 69f03f6f55a3c32af89fa470 | ### GPT-4o Average Score: 85.3. Result ID: 69f086bb47f34ce924d702f9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Category":"Closed-Source APIs","Release Date":"May 24"}. This record does not assert independent reproduction. ### Qwen3-Omni Average Score: 80.6. Result ID: 69f086bb47f34ce924d70301. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs","Release Date":"Sep 25"}. This record does not assert independent reproduction. ### Omni-o3 Average Score: 79.7. Result ID: 69f086bb47f34ce924d70308. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs"}. This record does not assert independent reproduction. ### Qwen3-VL Average Score: 79. Result ID: 69f086bb47f34ce924d702fc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Video MLLMs","Release Date":"Oct 25"}. This record does not assert independent reproduction. ### VideoRFT Average Score: 77.7. Result ID: 69f086bb47f34ce924d702fe. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Video MLLMs","Release Date":"May 25"}. This record does not assert independent reproduction. ### Ola Average Score: 76. Result ID: 69f086bb47f34ce924d70302. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs","Release Date":"Feb 25"}. This record does not assert independent reproduction. ### AVATAR Average Score: 75.7. Result ID: 69f086bb47f34ce924d70307. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs","Release Date":"CVPR 26"}. This record does not assert independent reproduction. ### HumanOmniV2 Average Score: 74.8. Result ID: 69f086bb47f34ce924d70306. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs","Release Date":"June 25"}. This record does not assert independent reproduction. ### Qwen2.5-VL Average Score: 74.7. Result ID: 69f086bb47f34ce924d702fb. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Video MLLMs","Release Date":"Feb 25"}. This record does not assert independent reproduction. ### Open-o3-video Average Score: 74.3. Result ID: 69f086bb47f34ce924d702fd. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Video MLLMs","Release Date":"Oct 25"}. This record does not assert independent reproduction. ### EchoInk-R1 Average Score: 73.1. Result ID: 69f086bb47f34ce924d70303. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs","Release Date":"May 25"}. This record does not assert independent reproduction. ### VideoChat-R1 Average Score: 72.7. Result ID: 69f086bb47f34ce924d702ff. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Video MLLMs","Release Date":"Apr 25"}. This record does not assert independent reproduction. ### AV-Reasoner Average Score: 72.7. Result ID: 69f086bb47f34ce924d70305. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs","Release Date":"June 25"}. This record does not assert independent reproduction. ### Gemini1.5Pro Average Score: 72.5. Result ID: 69f086bb47f34ce924d702fa. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Closed-Source APIs","Release Date":"Dec 24"}. This record does not assert independent reproduction. ### Qwen2.5-Omni Average Score: 72.4. Result ID: 69f086bb47f34ce924d70300. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs","Release Date":"Mar 25"}. This record does not assert independent reproduction. ### Omni-R1 Average Score: 68.1. Result ID: 69f086bb47f34ce924d70304. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Omnimodal MLLMs","Release Date":"May 25"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.