# VideoBench

Source: [VideoBench](<https://www.sota2.com/research/dataset/videobench>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Benchmarks

Page 1 of 2. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/dataset/videobench.md?page=2>): Follow this link to discover more pages.

- [Long Video Understanding on LongVideoBench](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench.md>): Long Video Understanding; LongVideoBench.

- [Long Video Understanding on LongVideoBench (val)](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench-val.md>): Long Video Understanding; LongVideoBench (val).

- [Video Question-Answering on LongVideoBench](<https://www.sota2.com/research/sota/video-question-answering-on-longvideobench.md>): Video Question-Answering; LongVideoBench.

- [Long-form Video Understanding on LongVideoBench (Accuracy)](<https://www.sota2.com/research/sota/long-form-video-understanding-on-longvideobench-accuracy.md>): Long-form Video Understanding; LongVideoBench.

- [Video Understanding on LongVideoBench](<https://www.sota2.com/research/sota/video-understanding-on-longvideobench.md>): Video Understanding; LongVideoBench.

- [Video Question Answering on LongVideoBench (val)](<https://www.sota2.com/research/sota/video-question-answering-on-longvideobench-val.md>): Video Question Answering; LongVideoBench (val).

- [Long Video Understanding on LongVideoBench (Accuracy)](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench-accuracy.md>): Long Video Understanding; LongVideoBench.

- [Video Understanding on LongVideoBench, MLVU, and VideoMME Aggregate](<https://www.sota2.com/research/sota/video-understanding-on-longvideobench-mlvu-and-videomme-aggregate.md>): Video Understanding; LongVideoBench, MLVU, and VideoMME Aggregate.

- [Video Understanding on LongVideoBench (Accuracy Delta)](<https://www.sota2.com/research/sota/video-understanding-on-longvideobench-accuracy-delta.md>): Video Understanding; LongVideoBench.

- [Video Understanding on OmniVideoBench](<https://www.sota2.com/research/sota/video-understanding-on-omnivideobench.md>): Video Understanding; OmniVideoBench.

- [Video Understanding on LongVideoBench 1-60min](<https://www.sota2.com/research/sota/video-understanding-on-longvideobench-1-60min.md>): Video Understanding; LongVideoBench 1-60min.

- [Video Understanding on VideoMME, EgoSchema, LongVideoBench, MVBench](<https://www.sota2.com/research/sota/video-understanding-on-videomme-egoschema-longvideobench-mvbench.md>): Video Understanding; VideoMME, EgoSchema, LongVideoBench, MVBench.

- [Video Understanding on LongVideoBench (Relation/Perception Metrics)](<https://www.sota2.com/research/sota/video-understanding-on-longvideobench-relation-perception-metrics.md>): Video Understanding; LongVideoBench.

- [Long-video Question Answering on Long VideoBench (val)](<https://www.sota2.com/research/sota/long-video-question-answering-on-long-videobench-val.md>): Long-video Question Answering; Long VideoBench (val).

- [Video-LLM Performance Calibration on Eval-OOD (EgoSchema & LongVideoBench)](<https://www.sota2.com/research/sota/video-llm-performance-calibration-on-eval-ood-egoschema-and-longvideobench.md>): Video-LLM performance calibration; Eval-OOD (EgoSchema & LongVideoBench).

- [Video Question Answering on LongVideoBench (LVB) 58 (test)](<https://www.sota2.com/research/sota/video-question-answering-on-longvideobench-lvb-58-test.md>): Video Question Answering; LongVideoBench (LVB) 58 (test).

- [Video Question Answering on LongVideoBench (test)](<https://www.sota2.com/research/sota/video-question-answering-on-longvideobench-test.md>): Video Question Answering; LongVideoBench (test).

- [Video Understanding on VideoMME, LongVideoBench, and MLVU](<https://www.sota2.com/research/sota/video-understanding-on-videomme-longvideobench-and-mlvu.md>): Video Understanding; VideoMME, LongVideoBench, and MLVU.

- [Audio-visual understanding on Audio-visual understanding evaluation suite (test)](<https://www.sota2.com/research/sota/audio-visual-understanding-on-audio-visual-understanding-evaluation-suite-test.md>): Audio-visual understanding; Audio-visual understanding evaluation suite (WorldSense, Daily-Omni, OmniVideoBench, Video-MME, and LVOmniBench) (test).

- [Long-context video understanding on LongVideoBench (test)](<https://www.sota2.com/research/sota/long-context-video-understanding-on-longvideobench-test.md>): Long-context video understanding; LongVideoBench (test).

- [Video Understanding on Average VideoMME, LongVideoBench, MLVU](<https://www.sota2.com/research/sota/video-understanding-on-average-videomme-longvideobench-mlvu.md>): Video Understanding; Average VideoMME, LongVideoBench, MLVU.

- [Video Understanding on LongVideoBench (test)](<https://www.sota2.com/research/sota/video-understanding-on-longvideobench-test.md>): Video Understanding; LongVideoBench (test).

- [Long-video understanding on LongVideoBench (Duration-Specific Metrics)](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench-duration-specific-metrics.md>): Long-video understanding; LongVideoBench.

- [Long Video Understanding on LongVideoBench (Performance & Efficiency)](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench-performance-and-efficiency.md>): Long Video Understanding; LongVideoBench.

- [Video Question Answering on LONGVIDEOBENCH Medium](<https://www.sota2.com/research/sota/video-question-answering-on-longvideobench-medium.md>): Video Question Answering; LONGVIDEOBENCH Medium.

- [General Video Understanding on LongVideoBench](<https://www.sota2.com/research/sota/general-video-understanding-on-longvideobench.md>): General Video Understanding; LongVideoBench.

- [Video Reasoning on LongVideoBench](<https://www.sota2.com/research/sota/video-reasoning-on-longvideobench.md>): Video Reasoning; LongVideoBench.

- [Multiple-choice Video Harmfulness Understanding on HarmVideoBench (test)](<https://www.sota2.com/research/sota/multiple-choice-video-harmfulness-understanding-on-harmvideobench-test.md>): Multiple-choice Video Harmfulness Understanding; HarmVideoBench (test).

- [Audio-Video Understanding on OmniVideoBench](<https://www.sota2.com/research/sota/audio-video-understanding-on-omnivideobench.md>): Audio-Video Understanding; OmniVideoBench.

- [Long-video understanding on LongVideoBench (LVB) (test)](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench-lvb-test.md>): Long-video understanding; LongVideoBench (LVB) (test).

- [Long-video understanding on LongVideoBench (LVB)](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench-lvb.md>): Long-video understanding; LongVideoBench (LVB).

- [Audio-Visual Video Understanding on OmniVideoBench truncated \<= 5min](<https://www.sota2.com/research/sota/audio-visual-video-understanding-on-omnivideobench-truncated-5min.md>): Audio-Visual Video Understanding; OmniVideoBench truncated \<= 5min.

- [Video Question Answering on LongVideoBench KFS-Bench (full set)](<https://www.sota2.com/research/sota/video-question-answering-on-longvideobench-kfs-bench-full-set.md>): Video Question Answering; LongVideoBench KFS-Bench (full set).

- [Long-form Video Understanding on LongVideoBench](<https://www.sota2.com/research/sota/long-form-video-understanding-on-longvideobench.md>): Long-form Video Understanding; LongVideoBench.

- [Video Question Answering on LongVideoBench (standard)](<https://www.sota2.com/research/sota/video-question-answering-on-longvideobench-standard.md>): Video Question Answering; LongVideoBench (standard).

- [Long Video Understanding on LongVideoBench 23sec-60 min](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench-23sec-60-min.md>): Long Video Understanding; LongVideoBench 23sec-60 min.

- [Long Video Understanding on LongVideoBench (test)](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench-test.md>): Long Video Understanding; LongVideoBench (test).

- [Omnimodal Question Answering on OmniVideoBench 1.0 (test)](<https://www.sota2.com/research/sota/omnimodal-question-answering-on-omnivideobench-1-0-test.md>): Omnimodal Question Answering; OmniVideoBench 1.0 (test).

- [Audio-visual Question Answering on OmniVideoBench](<https://www.sota2.com/research/sota/audio-visual-question-answering-on-omnivideobench.md>): Audio-visual Question Answering; OmniVideoBench.

- [Long-video understanding on LongVideoBench 0~60 min](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench-0-60-min.md>): Long-video understanding; LongVideoBench 0~60 min.

- [Long-Video Understanding on LongVideoBench 8s~60m](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench-8s-60m.md>): Long-Video Understanding; LongVideoBench 8s~60m.

- [Long Video Understanding on LongVideoBench (LongVB)](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench-longvb.md>): Long Video Understanding; LongVideoBench (LongVB).

- [Long Video Understanding on LongVideoBench 473s](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench-473s.md>): Long Video Understanding; LongVideoBench 473s.

- [Video Question Answering on LongVideoBench w/o sub. (val)](<https://www.sota2.com/research/sota/video-question-answering-on-longvideobench-w-o-sub-val.md>): Video Question Answering; LongVideoBench w/o sub. (val).

- [Long Video Reasoning on LongVideoBench](<https://www.sota2.com/research/sota/long-video-reasoning-on-longvideobench.md>): Long Video Reasoning; LongVideoBench.

- [Long Video Understanding on LongVideoBench 2024 (val)](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench-2024-val.md>): Long Video Understanding; LongVideoBench 2024 (val).

- [Video Understanding on MVBench, LongVideoBench, MLVU, and VideoMME](<https://www.sota2.com/research/sota/video-understanding-on-mvbench-longvideobench-mlvu-and-videomme.md>): Video Understanding; MVBench, LongVideoBench, MLVU, and VideoMME.

- [Multiple-choice Question Answering on LongVideoBench](<https://www.sota2.com/research/sota/multiple-choice-question-answering-on-longvideobench.md>): Multiple-choice question answering; LongVideoBench.

- [Video Understanding on LongVideoBench (LVB)](<https://www.sota2.com/research/sota/video-understanding-on-longvideobench-lvb.md>): Video Understanding; LongVideoBench (LVB).

- [Accuracy on LongVideoBench (Long-video understanding)](<https://www.sota2.com/research/sota/accuracy-on-longvideobench-long-video-understanding.md>): Long-video understanding; LongVideoBench average.

- [Fine-grained audio-visual video understanding on OmniVideoBench](<https://www.sota2.com/research/sota/fine-grained-audio-visual-video-understanding-on-omnivideobench.md>): Fine-grained audio-visual video understanding; OmniVideoBench.

- [Video Question Answering on SciVideoBench](<https://www.sota2.com/research/sota/video-question-answering-on-scivideobench.md>): Video Question Answering; SciVideoBench.

- [General Video Understanding on Combined (VideoMME, LVBench, LongVideoBench, EgoSchema, MLVU)](<https://www.sota2.com/research/sota/general-video-understanding-on-combined-videomme-lvbench-longvideobench-egoschema-mlvu.md>): General Video Understanding; Combined (VideoMME, LVBench, LongVideoBench, EgoSchema, MLVU).

- [Audio-Visual Joint Reasoning on OmniVideoBench](<https://www.sota2.com/research/sota/audio-visual-joint-reasoning-on-omnivideobench.md>): Audio-Visual Joint Reasoning; OmniVideoBench.

- [Video Understanding on VideoBench](<https://www.sota2.com/research/sota/video-understanding-on-videobench.md>): Video Understanding; VideoBench.

- [Video Understanding on LongVideoBench (full)](<https://www.sota2.com/research/sota/video-understanding-on-longvideobench-full.md>): Video Understanding; LongVideoBench (full).

- [VideoQA on LongVideoBench (Medium/Long/All Scores)](<https://www.sota2.com/research/sota/videoqa-on-longvideobench-medium-long-all-scores.md>): VideoQA; LongVideoBench.

- [CoT Length Prediction on LongVideoBench 60](<https://www.sota2.com/research/sota/cot-length-prediction-on-longvideobench-60.md>): CoT Length Prediction; LongVideoBench 60.

- [CoT Length Prediction on LongVideoBench 15](<https://www.sota2.com/research/sota/cot-length-prediction-on-longvideobench-15.md>): CoT Length Prediction; LongVideoBench 15.

- [Long-form Audio-Video Understanding on OmniVideoBench up to 30min](<https://www.sota2.com/research/sota/long-form-audio-video-understanding-on-omnivideobench-up-to-30min.md>): Long-form audio-video understanding; OmniVideoBench up to 30min.

- [Long-form Video Question Answering on LongVideoBench (test)](<https://www.sota2.com/research/sota/long-form-video-question-answering-on-longvideobench-test.md>): Long-form Video Question Answering; LongVideoBench (test).

- [Video Generation on MovieGenVideoBench 1003 prompts 1.0 (test)](<https://www.sota2.com/research/sota/video-generation-on-moviegenvideobench-1003-prompts-1-0-test.md>): Video Generation; MovieGenVideoBench 1003 prompts 1.0 (test).

- [Text-to-Video Generation on MovieGen VideoBench 250 Randomly Selected Prompts](<https://www.sota2.com/research/sota/text-to-video-generation-on-moviegen-videobench-250-randomly-selected-prompts.md>): Text-to-Video Generation; MovieGen VideoBench 250 Randomly Selected Prompts.

- [Video Question Answering on LongVideoBench (LVB)](<https://www.sota2.com/research/sota/video-question-answering-on-longvideobench-lvb.md>): Video Question Answering; LongVideoBench (LVB).

- [Long Video Understanding on LongVideoBench (LVB) (val)](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench-lvb-val.md>): Long Video Understanding; LongVideoBench (LVB) (val).

- [Video Reasoning on OmniVideoBench](<https://www.sota2.com/research/sota/video-reasoning-on-omnivideobench.md>): Video Reasoning; OmniVideoBench.

- [Speculative Decoding on LongVideoBench ~15k visual tokens](<https://www.sota2.com/research/sota/speculative-decoding-on-longvideobench-15k-visual-tokens.md>): Speculative Decoding; LongVideoBench ~15k visual tokens.

- [Long Video Understanding on LongVideoBench (8 sec~60 min)](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench-8-sec-60-min.md>): Long Video Understanding; LongVideoBench (8 sec~60 min).

- [Keyframe Retrieval on LONGVIDEOBENCH](<https://www.sota2.com/research/sota/keyframe-retrieval-on-longvideobench.md>): Keyframe Retrieval; LONGVIDEOBENCH.

- [Multi-modal Video Understanding on LongVideoBench (accuracy)](<https://www.sota2.com/research/sota/multi-modal-video-understanding-on-longvideobench-accuracy.md>): Multi-modal Video Understanding; LongVideoBench.

- [Long-form Video Understanding on LongVideoBench long (val)](<https://www.sota2.com/research/sota/long-form-video-understanding-on-longvideobench-long-val.md>): Long-form Video Understanding; LongVideoBench long (val).

- [Multi-Choice Q&A on LongVideoBench (val)](<https://www.sota2.com/research/sota/multi-choice-q-and-a-on-longvideobench-val.md>): Multi-Choice Q&A; LongVideoBench (val).

- [Long Video Understanding on LongVideoBench Long](<https://www.sota2.com/research/sota/long-video-understanding-on-longvideobench-long.md>): Long Video Understanding; LongVideoBench Long.

- [Image-to-Video on SeedVideoBench 2.0 (overall)](<https://www.sota2.com/research/sota/image-to-video-on-seedvideobench-2-0-overall.md>): Image-to-Video; SeedVideoBench 2.0 (overall).

- [Text-to-Video Generation on SeedVideoBench 2.0](<https://www.sota2.com/research/sota/text-to-video-generation-on-seedvideobench-2-0.md>): Text-to-Video Generation; SeedVideoBench 2.0.

- [Image-to-Video Generation on SeedVideoBench Audio dimension 2.0](<https://www.sota2.com/research/sota/image-to-video-generation-on-seedvideobench-audio-dimension-2-0.md>): Image-to-Video Generation; SeedVideoBench Audio dimension 2.0.

- [Image-to-Video Generation on SeedVideoBench Video dimension 2.0](<https://www.sota2.com/research/sota/image-to-video-generation-on-seedvideobench-video-dimension-2-0.md>): Image-to-Video Generation; SeedVideoBench Video dimension 2.0.

- [Omni-modal collaborative reasoning on OmniVideoBench](<https://www.sota2.com/research/sota/omni-modal-collaborative-reasoning-on-omnivideobench.md>): Omni-modal collaborative reasoning; OmniVideoBench.

- [KV Cache Allocation on LongVideoBench 60](<https://www.sota2.com/research/sota/kv-cache-allocation-on-longvideobench-60.md>): KV Cache Allocation; LongVideoBench 60.

- [KV Cache Allocation on LongVideoBench 15](<https://www.sota2.com/research/sota/kv-cache-allocation-on-longvideobench-15.md>): KV Cache Allocation; LongVideoBench 15.
