Video Understanding on SceneBench
99.4Title Prediction AccuracyGEMINI 2.5 PRO
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| GEMINI 2.5 PRORelease=2025, Frame Count=1fps2026.03 | 99.4 | 92.9 | 80.5 | 60.7 | 65.8 | 82.4 | 80.3 | |
| KIMI 2.5vRelease=2025, Frame Count=1282026.03 | 99.4 | 90.9 | 73.1 | 54 | 59.6 | 60.7 | 73 | |
| GEMINI 2.5 FLASH-LITERelease=2025, Frame Count=1fps2026.03 | 99.1 | 78.2 | 48.4 | 25.6 | 30.1 | 41.6 | 53.8 | |
| VIDEOLLAMA3-7BRelease=2025, Frame Count=1802026.03 | 99.1 | 83.5 | 58.1 | 26.1 | 29.8 | 46.9 | 57.3 | |
| VIDEO-CCAMRelease=2023, Frame Count=962026.03 | 98.8 | 79.7 | 51 | 29.3 | 33.3 | 37 | 54.9 | |
| INTERNVL2.5-7BRelease=2024, Frame Count=162026.03 | 98.6 | 79.3 | 48.3 | 27.9 | 30.5 | 40.7 | 54.2 | |
| QWEN2.5-VL-7BRelease=2024, Frame Count=322026.03 | 98.6 | 78.6 | 34.7 | 25.1 | 27.4 | 38.8 | 50.5 | |
| VIDEOR1-7BRelease=2025, Frame Count=162026.03 | 98.5 | 71.9 | 71.9 | 19.5 | 24.6 | 40.7 | 54.5 | |
| VIDEOCHAT2Release=2023, Frame Count=162026.03 | 98.3 | 72.5 | 45.4 | 31.5 | 36.1 | 33.2 | 52.8 | |
| MINICPM-V4.5Release=2025, Frame Count=5402026.03 | 98 | 72.4 | 62.5 | 30.7 | 34.9 | 50.1 | 58.1 | |
| LLAVA-ONEVISION-7BRelease=2024, Frame Count=162026.03 | 97.7 | 82 | 70.1 | 23.6 | 28.5 | 46.5 | 58.1 | |
| VIDEOLLAMA2-7BRelease=2024, Frame Count=162026.03 | 97.7 | 63.7 | 43.8 | 28.7 | 32 | 33.2 | 49.9 | |
| LONGVARelease=2024, Frame Count=1282026.03 | 96.8 | 71.1 | 54.3 | 27.7 | 29.5 | 40.1 | 53.3 | |
| LONG-LLAVARelease=2024, Frame Count=642026.03 | 96.2 | 79.7 | 57.1 | 26.1 | 25.4 | 33 | 52.9 | |
| LLAMA-VIDRelease=2023, Frame Count=1fps2026.03 | 94.5 | 56.1 | 66.3 | 23.7 | 24.3 | 32 | 49.5 | |
| MPLUG-OWL3-VRelease=2024, Frame Count=642026.03 | 91.3 | 74.1 | 54.1 | 24.3 | 28.7 | 40.7 | 52.2 | |
| MA-LMMRelease=2024, Frame Count=10002026.03 | 69.9 | 46.3 | 38.5 | 27.7 | 32.7 | 30.8 | 41 | |
| MOVIECHATRelease=2023, Frame Count=20482026.03 | 25.2 | 28.6 | 52.2 | 21.9 | 21.4 | 21.6 | 28.5 | |
| TIMECHATRelease=2024, Frame Count=962026.03 | 17.7 | 18.3 | 19.3 | 23.9 | 26.1 | 7.3 | 18.8 |