# General Video Understanding on VideoMME w/o sub Source: [General Video Understanding on VideoMME w/o sub]() Collection index: [llms.txt]() Data updated: 2026-06-18T07:02:02.924Z Evaluation of general video understanding capabilities on the VideoMME dataset subset excluding subtitles, measured by Accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | General Video Understanding | | Dataset (including any stated split) | VideoMME w/o sub | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | VideoCFR | 61.1 | Not recorded | 6a337b73206542251d7c4f8c | | VILA-1.5-40B | 60.1 | Not recorded | 6a337b73206542251d7c4f8c | | VideoCFR | 58.9 | Not recorded | 6a337b73206542251d7c4f8c | | LLaVA-OneVision-7B | 58.2 | Not recorded | 6a337b73206542251d7c4f8c | | VideoChat-R1 | 57.7 | Not recorded | 6a337b73206542251d7c4f8c | | Temporal-RLT | 57.6 | Not recorded | 6a337b73206542251d7c4f8c | | Kangeroo-8B | 56 | Not recorded | 6a337b73206542251d7c4f8c | | VideoCFR | 55.1 | Not recorded | 6a337b73206542251d7c4f8c | | Video-R1-7B | 54.3 | Not recorded | 6a337b73206542251d7c4f8c | | Qwen2.5-VL-7B | 52.8 | Not recorded | 6a337b73206542251d7c4f8c | | LongVA-7B | 52.6 | Not recorded | 6a337b73206542251d7c4f8c | | Video-UTR-7B | 52.6 | Not recorded | 6a337b73206542251d7c4f8c | | DeepVideo-R1 | 51.1 | Not recorded | 6a337b73206542251d7c4f8c | | VideoLLaMA2 | 47.9 | Not recorded | 6a337b73206542251d7c4f8c | | TinyLLaVA-Video-R1 | 46.6 | Not recorded | 6a337b73206542251d7c4f8c | | MARC-3B | 39.4 | Not recorded | 6a337b73206542251d7c4f8c | ### VideoCFR Accuracy: 61.1. Result ID: 6a339738fbc373592c304d9b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Frames":"64"}. This record does not assert independent reproduction. ### VILA-1.5-40B Accuracy: 60.1. Result ID: 6a339738fbc373592c304d8e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### VideoCFR Accuracy: 58.9. Result ID: 6a339738fbc373592c304d9a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Frames":"32"}. This record does not assert independent reproduction. ### LLaVA-OneVision-7B Accuracy: 58.2. Result ID: 6a339738fbc373592c304d90. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### VideoChat-R1 Accuracy: 57.7. Result ID: 6a339738fbc373592c304d94. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Frames":"16"}. This record does not assert independent reproduction. ### Temporal-RLT Accuracy: 57.6. Result ID: 6a339738fbc373592c304d97. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Frames":"32"}. This record does not assert independent reproduction. ### Kangeroo-8B Accuracy: 56. Result ID: 6a339738fbc373592c304d91. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### VideoCFR Accuracy: 55.1. Result ID: 6a339738fbc373592c304d99. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Frames":"16"}. This record does not assert independent reproduction. ### Video-R1-7B Accuracy: 54.3. Result ID: 6a339738fbc373592c304d93. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Frames":"16"}. This record does not assert independent reproduction. ### Qwen2.5-VL-7B Accuracy: 52.8. Result ID: 6a339738fbc373592c304d92. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LongVA-7B Accuracy: 52.6. Result ID: 6a339738fbc373592c304d8d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Video-UTR-7B Accuracy: 52.6. Result ID: 6a339738fbc373592c304d8f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### DeepVideo-R1 Accuracy: 51.1. Result ID: 6a339738fbc373592c304d95. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### VideoLLaMA2 Accuracy: 47.9. Result ID: 6a339738fbc373592c304d8c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### TinyLLaVA-Video-R1 Accuracy: 46.6. Result ID: 6a339738fbc373592c304d96. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Frames":"16"}. This record does not assert independent reproduction. ### MARC-3B Accuracy: 39.4. Result ID: 6a339738fbc373592c304d98. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Frames":"1"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.