# Long Video Question Answering on MLVU multiple-choice questions Source: [Long Video Question Answering on MLVU multiple-choice questions]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:30:15.534Z Evaluation of model performance on the MLVU dataset focusing on long video multiple-choice questions for Video Question Answering, measured by Accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Long Video Question Answering | | Dataset (including any stated split) | MLVU multiple-choice questions | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 12 of 12 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | VideoXL | 0.649 | Not recorded | 68fa767f1e209131cea6d744 | | Video-CCAM | 0.631 | Not recorded | 68fa767f1e209131cea6d744 | | Dispider | 0.617 | Not recorded | 68fa767f1e209131cea6d744 | | Kangaroo | 0.61 | Not recorded | 68fa767f1e209131cea6d744 | | LongVA | 0.563 | Not recorded | 68fa767f1e209131cea6d744 | | Video-LLaMA2 | 0.485 | Not recorded | 68fa767f1e209131cea6d744 | | VideoChat2 | 0.479 | Not recorded | 68fa767f1e209131cea6d744 | | Video-LLaVA | 0.473 | Not recorded | 68fa767f1e209131cea6d744 | | ShareGPT4Video | 0.464 | Not recorded | 68fa767f1e209131cea6d744 | | LLaMA-VID | 0.332 | Not recorded | 68fa767f1e209131cea6d744 | | TimeChat | 0.309 | Not recorded | 68fa767f1e209131cea6d744 | | MovieChat | 0.258 | Not recorded | 68fa767f1e209131cea6d744 | ### VideoXL Accuracy: 0.649. Result ID: 69943ee23a6c3148491c07f0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Size":"7B","Frames":"128"}. This record does not assert independent reproduction. ### Video-CCAM Accuracy: 0.631. Result ID: 69943ee23a6c3148491c07ef. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Size":"14B","Frames":"96"}. This record does not assert independent reproduction. ### Dispider Accuracy: 0.617. Result ID: 69943ee23a6c3148491c07f1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM Size":"7B","Frames":"1 FPS"}. This record does not assert independent reproduction. ### Kangaroo Accuracy: 0.61. Result ID: 69943ee23a6c3148491c07ee. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Size":"8B","Frames":"64"}. This record does not assert independent reproduction. ### LongVA Accuracy: 0.563. Result ID: 69943ee23a6c3148491c07ed. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM Size":"7B","Frames":"128"}. This record does not assert independent reproduction. ### Video-LLaMA2 Accuracy: 0.485. Result ID: 69943ee23a6c3148491c07ea. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM Size":"7B","Frames":"16"}. This record does not assert independent reproduction. ### VideoChat2 Accuracy: 0.479. Result ID: 69943ee23a6c3148491c07ec. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Size":"7B","Frames":"16"}. This record does not assert independent reproduction. ### Video-LLaVA Accuracy: 0.473. Result ID: 69943ee23a6c3148491c07e6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM Size":"7B","Frames":"8"}. This record does not assert independent reproduction. ### ShareGPT4Video Accuracy: 0.464. Result ID: 69943ee23a6c3148491c07eb. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM Size":"8B","Frames":"16"}. This record does not assert independent reproduction. ### LLaMA-VID Accuracy: 0.332. Result ID: 69943ee23a6c3148491c07e7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM Size":"7B","Frames":"1 FPS"}. This record does not assert independent reproduction. ### TimeChat Accuracy: 0.309. Result ID: 69943ee23a6c3148491c07e8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM Size":"7B","Frames":"96"}. This record does not assert independent reproduction. ### MovieChat Accuracy: 0.258. Result ID: 69943ee23a6c3148491c07e9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM Size":"7B","Frames":"2048"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.