# Professional-level Knowledge Acquisition on VideoMMMU Source: [Professional-level Knowledge Acquisition on VideoMMMU]() Collection index: [llms.txt]() Data updated: 2026-03-20T08:25:58.487Z Evaluation of model performance on the VideoMMMU dataset specifically targeting professional-level knowledge acquisition capabilities. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Professional-level Knowledge Acquisition | | Dataset (including any stated split) | VideoMMMU | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 13 of 13 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. - [Average Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | Gemini-2.5-Pro | 83.6 | Not recorded | 69bcd45d0636e5bf4afc27b3 | | GPT-4o | 61.2 | Not recorded | 69bcd45d0636e5bf4afc27b3 | | Insight-V++ | 57.6 | Not recorded | 69bcd45d0636e5bf4afc27b3 | | Insight-V | 55.8 | Not recorded | 69bcd45d0636e5bf4afc27b3 | | Gemini-1.5-Pro | 53.9 | Not recorded | 69bcd45d0636e5bf4afc27b3 | | Video-R1 | 52.4 | Not recorded | 69bcd45d0636e5bf4afc27b3 | | Gemini-1.5-Flash | 49.8 | Not recorded | 69bcd45d0636e5bf4afc27b3 | | VideoChat-R1 | 49.6 | Not recorded | 69bcd45d0636e5bf4afc27b3 | | Qwen2.5-VL | 47.4 | Not recorded | 69bcd45d0636e5bf4afc27b3 | | VideoLLaMA3 | 47 | Not recorded | 69bcd45d0636e5bf4afc27b3 | | VideoChat-Flash | 41.7 | Not recorded | 69bcd45d0636e5bf4afc27b3 | | LLaVA-Video | 36.1 | Not recorded | 69bcd45d0636e5bf4afc27b3 | | LLaVA-OneVision | 33.9 | Not recorded | 69bcd45d0636e5bf4afc27b3 | ### Gemini-2.5-Pro Accuracy: 83.6. Result ID: 69bd048947f34ce924a703fd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"-","Evaluation Frames":"64"}. This record does not assert independent reproduction. ### GPT-4o Accuracy: 61.2. Result ID: 69bd048947f34ce924a703fa. [Reporting paper]() Recorded evaluation configuration: {"Size":"-","Evaluation Frames":"64"}. This record does not assert independent reproduction. ### Insight-V++ Accuracy: 57.6. Result ID: 69bd048947f34ce924a70406. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","Evaluation Frames":"64"}. This record does not assert independent reproduction. ### Insight-V Accuracy: 55.8. Result ID: 69bd048947f34ce924a70405. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","Evaluation Frames":"64"}. This record does not assert independent reproduction. ### Gemini-1.5-Pro Accuracy: 53.9. Result ID: 69bd048947f34ce924a703fb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"-","Evaluation Frames":"64"}. This record does not assert independent reproduction. ### Video-R1 Accuracy: 52.4. Result ID: 69bd048947f34ce924a70402. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","Evaluation Frames":"64"}. This record does not assert independent reproduction. ### Gemini-1.5-Flash Accuracy: 49.8. Result ID: 69bd048947f34ce924a703fc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"-","Evaluation Frames":"64"}. This record does not assert independent reproduction. ### VideoChat-R1 Accuracy: 49.6. Result ID: 69bd048947f34ce924a70403. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","Evaluation Frames":"64"}. This record does not assert independent reproduction. ### Qwen2.5-VL Accuracy: 47.4. Result ID: 69bd048947f34ce924a70404. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","Evaluation Frames":"64"}. This record does not assert independent reproduction. ### VideoLLaMA3 Accuracy: 47. Result ID: 69bd048947f34ce924a70400. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","Evaluation Frames":"64"}. This record does not assert independent reproduction. ### VideoChat-Flash Accuracy: 41.7. Result ID: 69bd048947f34ce924a70401. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","Evaluation Frames":"64"}. This record does not assert independent reproduction. ### LLaVA-Video Accuracy: 36.1. Result ID: 69bd048947f34ce924a703ff. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Size":"7B","Evaluation Frames":"64"}. This record does not assert independent reproduction. ### LLaVA-OneVision Accuracy: 33.9. Result ID: 69bd048947f34ce924a703fe. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Size":"7B","Evaluation Frames":"64"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.