# Video Question Answering on Video-MME w.o. sub. Short

Source: [Video Question Answering on Video-MME w.o. sub. Short](<https://www.sota2.com/research/sota/video-question-answering-on-video-mme-w-o-sub-short>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-07-03T07:10:42.853Z

Evaluation of model performance on the Video-MME dataset variant specifically focusing on short questions/clips without subtitles.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Video Question Answering |
| Dataset (including any stated split) | Video-MME w.o. sub. Short |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/video-question-answering-on-video-mme-w-o-sub-short.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| Qwen2-VL + ReQuest | 80 | Not recorded | 6a47420b143ebdcacacc5c6e |
| Qwen2-VL | 78.6 | Not recorded | 6a47420b143ebdcacacc5c6e |
| LLaVA-Video + ReQuest | 77 | Not recorded | 6a47420b143ebdcacacc5c6e |
| LLaVA-Video | 76.2 | Not recorded | 6a47420b143ebdcacacc5c6e |
| NVILA | 75 | Not recorded | 6a47420b143ebdcacacc5c6e |
| LLaVa-OneVision + ReQuest | 71.7 | Not recorded | 6a47420b143ebdcacacc5c6e |
| LLaVa-OneVision | 70.3 | Not recorded | 6a47420b143ebdcacacc5c6e |
| VideoTree | 67.8 | Not recorded | 6a47420b143ebdcacacc5c6e |
| Frame-Voyager | 67.3 | Not recorded | 6a47420b143ebdcacacc5c6e |
| LongVU | 64.7 | Not recorded | 6a47420b143ebdcacacc5c6e |
| LLoVi | 62.1 | Not recorded | 6a47420b143ebdcacacc5c6e |
| VideoLLaMA2 | 56 | Not recorded | 6a47420b143ebdcacacc5c6e |
| VideoChat2 | 48.3 | Not recorded | 6a47420b143ebdcacacc5c6e |
| ShareGPT4Video | 48.3 | Not recorded | 6a47420b143ebdcacacc5c6e |
| Chat-UniVi-V1.5 | 45.7 | Not recorded | 6a47420b143ebdcacacc5c6e |
| Video-LLaVA | 45.3 | Not recorded | 6a47420b143ebdcacacc5c6e |

### Qwen2-VL + ReQuest

Accuracy: 80. Result ID: 6a47607160b88bb339928648.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

Recorded evaluation configuration: {"LLM Size":"8B","#Frames":"≤ 512","zero-shot transfer":"true"}. This record does not assert independent reproduction.

### Qwen2-VL

Accuracy: 78.6. Result ID: 6a47607160b88bb339928647.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db54d6b0dd3342930f66.md>)

Recorded evaluation configuration: {"LLM Size":"8B","#Frames":"512","reproduced":"true"}. This record does not assert independent reproduction.

### LLaVA-Video + ReQuest

Accuracy: 77. Result ID: 6a47607160b88bb339928644.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"32"}. This record does not assert independent reproduction.

### LLaVA-Video

Accuracy: 76.2. Result ID: 6a47607160b88bb339928643.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a561e209131cea82934.md>)

[Implementation](<https://llava-vl.github.io/blog/llava-video>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"32","reproduced":"true"}. This record does not assert independent reproduction.

### NVILA

Accuracy: 75. Result ID: 6a47607160b88bb339928640.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77481e209131cea723b2.md>)

Recorded evaluation configuration: {"LLM Size":"8B","#Frames":"1024"}. This record does not assert independent reproduction.

### LLaVa-OneVision + ReQuest

Accuracy: 71.7. Result ID: 6a47607160b88bb339928646.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"32","zero-shot transfer":"true"}. This record does not assert independent reproduction.

### LLaVa-OneVision

Accuracy: 70.3. Result ID: 6a47607160b88bb339928645.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa756f1e209131cea67e58.md>)

[Implementation](<https://llava-vl.github.io/blog/llava-onevision>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"32","reproduced":"true"}. This record does not assert independent reproduction.

### VideoTree

Accuracy: 67.8. Result ID: 6a47607160b88bb339928642.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa777a1e209131cea73736.md>)

[Implementation](<https://videotree2024.github.io/>)

Recorded evaluation configuration: {"LLM Size":"–","#Frames":"–"}. This record does not assert independent reproduction.

### Frame-Voyager

Accuracy: 67.3. Result ID: 6a47607160b88bb33992863e.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77b81e209131cea74f5d.md>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"8"}. This record does not assert independent reproduction.

### LongVU

Accuracy: 64.7. Result ID: 6a47607160b88bb33992863f.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75511e209131cea671f3.md>)

[Implementation](<https://github.com/Vision-CAIR/LongVU>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"1fps"}. This record does not assert independent reproduction.

### LLoVi

Accuracy: 62.1. Result ID: 6a47607160b88bb339928641.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75261e209131cea6629c.md>)

[Implementation](<https://github.com/CeeZh/LLoVi>)

Recorded evaluation configuration: {"LLM Size":"–","#Frames":"–"}. This record does not assert independent reproduction.

### VideoLLaMA2

Accuracy: 56. Result ID: 6a47607160b88bb33992863d.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75761e209131cea681dd.md>)

[Implementation](<https://github.com/DAMO-NLP-SG/VideoLLaMA2>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"16"}. This record does not assert independent reproduction.

### VideoChat2

Accuracy: 48.3. Result ID: 6a47607160b88bb33992863a.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71ba1e209131cea52cc7.md>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"16"}. This record does not assert independent reproduction.

### ShareGPT4Video

Accuracy: 48.3. Result ID: 6a47607160b88bb33992863b.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa738e1e209131cea5d310.md>)

[Implementation](<https://sharegpt4video.github.io/>)

Recorded evaluation configuration: {"LLM Size":"8B","#Frames":"16"}. This record does not assert independent reproduction.

### Chat-UniVi-V1.5

Accuracy: 45.7. Result ID: 6a47607160b88bb33992863c.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72d31e209131cea58bff.md>)

[Implementation](<https://github.com/PKU-YuanGroup/Chat-UniVi>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"64"}. This record does not assert independent reproduction.

### Video-LLaVA

Accuracy: 45.3. Result ID: 6a47607160b88bb339928639.

[Reporting paper](<https://www.sota2.com/research/paper/6a47420b143ebdcacacc5c6e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75051e209131cea65534.md>)

[Implementation](<https://github.com/PKU-YuanGroup/Video-LLaVA>)

Recorded evaluation configuration: {"LLM Size":"7B","#Frames":"8"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.