Long Video Understanding on LongVideoBench (val)
80AccuracyLVAgent
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LVAgentAuxiliary Subtitles=true2025.12 | 80 | — | — | — | — | |
| VideoChat-A1Model=GPT-4o, Frame Budget (K)=384, Evaluation Protocol=Stratified random 25% subset2026.03 | 77.2 | — | — | — | — | |
| Gemini 2.5 ProAccess Type=API call only2026.01 | 76.8 | — | — | — | — | |
| Gemini-2.5-ProAccess=Proprietary2026.02 | 76.8 | — | — | — | — | |
| Gemini 2.5 ProCategory=API call only2026.03 | 76.8 | — | — | — | — | |
| Gemini 3 ProAccess Type=API call only2026.01 | 75.9 | — | — | — | — | |
| Gemini-3-ProAccess=Proprietary2026.02 | 75.9 | — | — | — | — | |
| Gemini 3 ProCategory=API call only2026.03 | 75.9 | — | — | — | — | |
| Seed-1.5-VL2025.12 | 74.4 | — | — | — | — | |
| AVPBackbone=Gemini-2.5-Pro2025.12 | 73.4 | — | — | — | — | |
| Gemini 2.5 FlashAccess Type=API call only2026.01 | 73.1 | — | — | — | — | |
| Gemini 2.5 FlashCategory=API call only2026.03 | 73.1 | — | — | — | — | |
| GPT-5Access Type=API call only2026.01 | 72.6 | — | — | — | — | |
| GPT-5Access=Proprietary2026.02 | 72.6 | — | — | — | — | |
| GPT-5Category=API call only2026.03 | 72.6 | — | — | — | — | |
| DeepVideoDiscovery (DVD)2025.12 | 71.6 | — | — | — | — | |
| LensWalkReasoner=o3, Observer=o32026.03 | 70.6 | — | — | — | — | |
| AVPBackbone=Gemini-2.5-Flash2025.12 | 70.2 | — | — | — | — | |
| HiMuModel=Gemini-2.5-Flash, Frame Budget (K)=16, Evaluation Protocol=Stratified random 25% subset2026.03 | 70.13 | — | — | — | — | |
| LensWalkReasoner=o3, Observer=GPT-4.12026.03 | 69.9 | — | — | — | — | |
| Gemini-2.5-Pro2025.12 | 69.8 | — | — | — | — | |
| GPT-5 miniAccess Type=API call only2026.01 | 69.7 | — | — | — | — | |
| GPT-5 miniCategory=API call only2026.03 | 69.7 | — | — | — | — | |
| LensWalkReasoner=GPT-5, Observer=GPT-52026.03 | 68.8 | — | — | — | — | |
| Deep Video Discovery2026.03 | 68.6 | — | — | — | — | |
| Molmo2-4BAccess Type=Molmo2 family2026.01 | 68 | — | — | — | — | |
| Molmo2-4BCategory=Fully open2026.03 | 68 | — | — | — | — | |
| VideoDetective (SeedVL-1.5)Param=20B(A), Frames=322026.03 | 67.9 | — | — | — | — | |
| LongVPO (512f) Stage 1Size=8B, Frames=512, Backbone=InternVideo2.52026.02 | 67.8 | — | — | — | — | |
| Molmo2-8BAccess Type=Molmo2 family2026.01 | 67.5 | — | — | — | — | |
| Molmo2-8BCategory=Fully open2026.03 | 67.5 | — | — | — | — | |
| LensWalkReasoner=o3, Observer=Qwen2.5-VL-72B2026.03 | 67.3 | — | — | — | — | |
| MolmoPoint-8BCategory=MolmoPoint2026.03 | 67.3 | — | — | — | — | |
| LongVPO (256f) Stage 2-iter1Size=8B, Frames=512, Backbone=InternVideo2.52026.02 | 67.2 | — | — | — | — | |
| LongVPO (256f) Stage 2-iter2Size=8B, Frames=512, Backbone=InternVideo2.52026.02 | 67.2 | — | — | — | — | |
| LongVPO (256f) Stage 1Size=8B, Frames=512, Backbone=InternVideo2.52026.02 | 67 | — | — | — | — | |
| AdaReTaKe2025.12 | 67 | — | — | — | — | |
| LongVPO (128f) Stage 1Size=8B, Frames=512, Backbone=InternVL32026.02 | 66.8 | — | — | — | — | |
| GPT-4o2024.08 | 66.7 | — | — | — | — | |
| GPT-4o2024.08 | 66.7 | — | — | — | — | |
| GPT-4ocategory=Proprietary2024.10 | 66.7 | — | — | — | — | |
| GPT-4o2024.12 | 66.7 | — | — | — | — | |
| GPT4-oSize=Undisclosed2026.02 | 66.7 | — | — | — | — | |
| GPT-4o#Frames=384, Model Type=Closed-source Models2026.01 | 66.7 | — | — | — | — | |
| GPT-4oSize=—2026.01 | 66.7 | — | — | — | — | |
| GPT-4o2025.12 | 66.7 | — | — | — | — | |
| GPT-4oParam=-, Frames=3842026.03 | 66.7 | — | — | — | — | |
| GPT-4o# Params=-2026.06 | 66.7 | — | — | — | — | |
| LongVPO (128f) Stage 2Size=8B, Frames=512, Backbone=InternVL2.52026.02 | 66.6 | — | — | — | — | |
| Eagle2.5-8BAccess Type=Open weights only2026.01 | 66.4 | — | — | — | — | |
| Eagle2.5-8BCategory=Open weights2026.03 | 66.4 | — | — | — | — | |
| Gemini-2.5-Flash2025.12 | 66.2 | — | — | — | — | |
| LongVPO (128f) Stage 2Size=8B, Frames=768, Backbone=InternVL32026.02 | 66 | — | — | — | — | |
| LongVPO (256f) Stage 1Size=8B, Frames=512, Backbone=InternVL2.52026.02 | 66 | — | — | — | — | |
| Keye-VL-1.5-8BAccess Type=Open weights only2026.01 | 66 | — | — | — | — | |
| Keye-VL-1.5-8BCategory=Open weights2026.03 | 66 | — | — | — | — | |
| GLM-4.1V-9BAccess Type=Open weights only2026.01 | 65.7 | — | — | — | — | |
| GLM-4.1V-9BCategory=Open weights2026.03 | 65.7 | — | — | — | — | |
| LongVPO (128f) Stage 1Size=8B, Frames=512, Backbone=InternVL2.52026.02 | 65.4 | — | — | — | — | |
| FrameOracleBackbone=Qwen3-VL-8B, Frames=128→27.82025.10 | 65.2 | — | — | — | — | |
| Claude Sonnet 4.5Access Type=API call only2026.01 | 65.1 | — | — | — | — | |
| Claude-Sonnet-4.5Access=Proprietary2026.02 | 65.1 | — | — | — | — | |
| HiMuModel=GPT-4o, Frame Budget (K)=16, Evaluation Protocol=Stratified random 25% subset2026.03 | 65.1 | — | — | — | — | |
| Claude Sonnet 4.5Category=API call only2026.03 | 65.1 | — | — | — | — | |
| VideoChat-FlashSize=7B, Frames=5122026.02 | 64.7 | — | — | — | — | |
| VideoChat-Flash-7BAccess Type=Open models2026.01 | 64.7 | — | — | — | — | |
| VideoChat-Flash-7BCategory=Fully open2026.03 | 64.7 | — | — | — | — | |
| GPT-4.12026.03 | 64.6 | — | — | — | — | |
| Vanilla MoEBackbone=KIMI-VL-A3B-INSTRUCT2026.04 | 64.37 | — | — | — | — | |
| MACS (Ours)Backbone=KIMI-VL-A3B-INSTRUCT2026.04 | 64.24 | — | — | — | — | |
| HiMuModel=Qwen3-VL-8B, Frame Budget (K)=16, Evaluation Protocol=Full benchmark2026.03 | 64.19 | — | — | — | — | |
| HiMuModel=InternVL-3.5-8B, Frame Budget (K)=16, Evaluation Protocol=Full benchmark2026.03 | 64.11 | — | — | — | — | |
| Gemini-1.5-Pro2024.08 | 64 | — | — | — | — | |
| Gemini-1.5-Procategory=Proprietary2024.10 | 64 | — | — | — | — | |
| Gemini-1.5-ProSize=Undisclosed2026.02 | 64 | — | — | — | — | |
| Gemini-1.5-pro#Frames=256, Model Type=Closed-source Models2026.01 | 64 | — | — | — | — | |
| Gemini-1.5-ProParam=-, Frames=2562026.03 | 64 | — | — | — | — | |
| Gemini-1.5-Pro# Params=-2026.06 | 64 | — | — | — | — | |
| FrameOracleBackbone=Qwen3-VL-8B, Frames=32→20.92025.10 | 64 | — | — | — | — | |
| MACS (w/o Expanded)Backbone=KIMI-VL-A3B-INSTRUCT2026.04 | 63.95 | — | — | — | — | |
| MiniCPM-V-4.5-8BAccess Type=Open weights only2026.01 | 63.9 | — | — | — | — | |
| LLaVA-VideoParam=72B, Frames=642026.03 | 63.9 | — | — | — | — | |
| MiniCPM-V-4.5-8BCategory=Open weights2026.03 | 63.9 | — | — | — | — | |
| SeedVL-1.5Param=20B(A), Frames=322026.03 | 63.8 | — | — | — | — | |
| Vanilla MoEBackbone=INTERNVL3.5-30B-A3B2026.04 | 63.76 | — | — | — | — | |
| Seed1.5VL-pro#Frames=32, Model Type=Closed-source Models2026.01 | 63.7 | — | — | — | — | |
| Molmo2-O-7BAccess Type=Molmo2 family2026.01 | 63.7 | — | — | — | — | |
| Molmo2-O-7BCategory=Fully open2026.03 | 63.7 | — | — | — | — | |
| MACS (Ours)Backbone=INTERNVL3.5-30B-A3B2026.04 | 63.55 | — | — | — | — | |
| VSLSModel=GPT-4o, Frame Budget (K)=32, Evaluation Protocol=Stratified random 25% subset2026.03 | 63.4 | — | — | — | — | |
| Qwen3-VL-8BFrames=322025.10 | 63.3 | — | — | — | — | |
| LLaVA-OneVision-72BModel Scale=72B2024.08 | 63.2 | — | — | — | — | |
| InternVideo2.5*Size=8B, Frames=5122026.02 | 63.2 | — | — | — | — | |
| MACS (w/o Expanded)Backbone=INTERNVL3.5-30B-A3B2026.04 | 63.11 | — | — | — | — | |
| ARIAactivated_params=3.9B (25.3B), category=Open-source2024.10 | 63 | — | — | — | — | |
| Qwen3-VL-4BAccess Type=Open weights only2026.01 | 62.8 | — | — | — | — | |
| Qwen3-VL-4BCategory=Open weights2026.03 | 62.8 | — | — | — | — | |
| InternVL2.5*Size=8B, Frames=5122026.02 | 62.7 | — | — | — | — | |
| AKSFrames=642025.10 | 62.7 | — | — | — | — | |
| BaselineRetained Tokens=All 64 x 169, Token Reduction Ratio=0%, Number of Frames=642026.06 | 62.5 | — | — | 59 | 65 |