# Video Question Answering on Video-MME w.o. sub. Overall

Source: [Video Question Answering on Video-MME w.o. sub. Overall](<https://www.sota2.com/research/sota/video-question-answering-on-video-mme-w-o-sub-overall>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-07-03T07:10:42.834Z

Evaluation of model performance on the Video-MME dataset variant excluding subtitles ('w.o. sub. Overall') for Video Question Answering, reporting Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Video Question Answering |
| Dataset (including any stated split) | Video-MME w.o. sub. Overall |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 17 of 17 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/video-question-answering-on-video-mme-w-o-sub-overall.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| Qwen2-VL + ReQuest | 71.1 | Not recorded | 6a47420b143ebdcacacc5c6e |
| Qwen2-VL | 70 | Not recorded | 6a47420b143ebdcacacc5c6e |
| LLaVA-Video + ReQuest | 65.6 | Not recorded | 6a47420b143ebdcacacc5c6e |
| NVILA | 64 | Not recorded | 6a47420b143ebdcacacc5c6e |
| LLaVA-Video | 62.6 | Not recorded | 6a47420b143ebdcacacc5c6e |
| LongVU | 60.9 | Not recorded | 6a47420b143ebdcacacc5c6e |
| LLaVa-OneVision + ReQuest | 60.9 | Not recorded | 6a47420b143ebdcacacc5c6e |
| VideoTree | 60.6 | Not recorded | 6a47420b143ebdcacacc5c6e |
| LLaVa-OneVision | 58.7 | Not recorded | 6a47420b143ebdcacacc5c6e |
| Frame-Voyager | 57.5 | Not recorded | 6a47420b143ebdcacacc5c6e |
| LLoVi | 54.7 | Not recorded | 6a47420b143ebdcacacc5c6e |
| VideoLLaMA2 | 47.9 | Not recorded | 6a47420b143ebdcacacc5c6e |
| TimeSuite | 46.3 | Not recorded | 6a47420b143ebdcacacc5c6e |
| Chat-UniVi-V1.5 | 40.6 | Not recorded | 6a47420b143ebdcacacc5c6e |
| Video-LLaVA | 39.9 | Not recorded | 6a47420b143ebdcacacc5c6e |
| ShareGPT4Video | 39.9 | Not recorded | 6a47420b143ebdcacacc5c6e |
| VideoChat2 | 39.5 | Not recorded | 6a47420b143ebdcacacc5c6e |

### Qwen2-VL + ReQuest

Accuracy: 71.1. Result ID: 6a47607160b88bb339928638.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

Recorded evaluation configuration: {"LLM Size":"8B","#Frames":"≤ 512","zero-shot transfer":"true"}. This record does not assert independent reproduction.

### Qwen2-VL

Accuracy: 70. Result ID: 6a47607160b88bb339928637.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db54d6b0dd3342930f66.md>)

Recorded evaluation configuration: {"LLM Size":"8B","#Frames":"512","reproduced":"true"}. This record does not assert independent reproduction.

### LLaVA-Video + ReQuest

Accuracy: 65.6. Result ID: 6a47607160b88bb339928634.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"32"}. This record does not assert independent reproduction.

### NVILA

Accuracy: 64. Result ID: 6a47607160b88bb339928630.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77481e209131cea723b2.md>)

Recorded evaluation configuration: {"LLM Size":"8B","#Frames":"1024"}. This record does not assert independent reproduction.

### LLaVA-Video

Accuracy: 62.6. Result ID: 6a47607160b88bb339928633.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a561e209131cea82934.md>)

[Implementation](<https://llava-vl.github.io/blog/llava-video>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"32","reproduced":"true"}. This record does not assert independent reproduction.

### LongVU

Accuracy: 60.9. Result ID: 6a47607160b88bb33992862f.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75511e209131cea671f3.md>)

[Implementation](<https://github.com/Vision-CAIR/LongVU>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"1fps"}. This record does not assert independent reproduction.

### LLaVa-OneVision + ReQuest

Accuracy: 60.9. Result ID: 6a47607160b88bb339928636.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"32","zero-shot transfer":"true"}. This record does not assert independent reproduction.

### VideoTree

Accuracy: 60.6. Result ID: 6a47607160b88bb339928632.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa777a1e209131cea73736.md>)

[Implementation](<https://videotree2024.github.io/>)

Recorded evaluation configuration: {"LLM Size":"–","#Frames":"–"}. This record does not assert independent reproduction.

### LLaVa-OneVision

Accuracy: 58.7. Result ID: 6a47607160b88bb339928635.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa756f1e209131cea67e58.md>)

[Implementation](<https://llava-vl.github.io/blog/llava-onevision>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"32","reproduced":"true"}. This record does not assert independent reproduction.

### Frame-Voyager

Accuracy: 57.5. Result ID: 6a47607160b88bb33992862e.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77b81e209131cea74f5d.md>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"8"}. This record does not assert independent reproduction.

### LLoVi

Accuracy: 54.7. Result ID: 6a47607160b88bb339928631.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75261e209131cea6629c.md>)

[Implementation](<https://github.com/CeeZh/LLoVi>)

Recorded evaluation configuration: {"LLM Size":"–","#Frames":"–"}. This record does not assert independent reproduction.

### VideoLLaMA2

Accuracy: 47.9. Result ID: 6a47607160b88bb33992862c.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75761e209131cea681dd.md>)

[Implementation](<https://github.com/DAMO-NLP-SG/VideoLLaMA2>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"16"}. This record does not assert independent reproduction.

### TimeSuite

Accuracy: 46.3. Result ID: 6a47607160b88bb33992862d.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76f11e209131cea7022c.md>)

[Implementation](<https://github.com/OpenGVLab/TimeSuite>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"128"}. This record does not assert independent reproduction.

### Chat-UniVi-V1.5

Accuracy: 40.6. Result ID: 6a47607160b88bb33992862b.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72d31e209131cea58bff.md>)

[Implementation](<https://github.com/PKU-YuanGroup/Chat-UniVi>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"64"}. This record does not assert independent reproduction.

### Video-LLaVA

Accuracy: 39.9. Result ID: 6a47607160b88bb339928628.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75051e209131cea65534.md>)

[Implementation](<https://github.com/PKU-YuanGroup/Video-LLaVA>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"8"}. This record does not assert independent reproduction.

### ShareGPT4Video

Accuracy: 39.9. Result ID: 6a47607160b88bb33992862a.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa738e1e209131cea5d310.md>)

[Implementation](<https://sharegpt4video.github.io/>)

Recorded evaluation configuration: {"LLM Size":"8B","#Frames":"16"}. This record does not assert independent reproduction.

### VideoChat2

Accuracy: 39.5. Result ID: 6a47607160b88bb339928629.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71ba1e209131cea52cc7.md>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"16"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.