Video Reasoning on SAGE-Bench 1.0 (test)
73.4Overall ScoreSAGE-Flash
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SAGE-FlashOrchestrator=SAGE-MM: GPT-4o, Train Mode=N/A, Eval Mode=AGENT2025.12 | 73.4 | 81 | 66.9 | 78.2 | 79.9 | 71.1 | |
| SAGE-FlashOrchestrator=SAGE-MM: Qwen3-VL-8B-Instruct [+SFT] [+RL], Train Mode=AGENT, Eval Mode=AGENT2025.12 | 71.8 | 82.8 | 62.4 | 75.1 | 79.1 | 69.9 | |
| GPT-4oOrchestrator=N/A, Train Mode=DIRECT, Eval Mode=DIRECT2025.12 | 71.6 | 80.9 | 63.6 | 75.1 | 73.9 | 70.1 | |
| SAGE-FlashOrchestrator=SAGE-MM: Gemini-2.5-Flash, Train Mode=N/A, Eval Mode=AGENT2025.12 | 71.3 | 81.2 | 62.9 | 76.3 | 84.3 | 68.3 | |
| SAGEOrchestrator=SAGE-MM: Qwen3-VL-4B-Instruct [+SFT] [+RL], Train Mode=AGENT, Eval Mode=AGENT2025.12 | 68.4 | 81.3 | 57.4 | 78.4 | 80.6 | 63.8 | |
| Gemini-2.5-FlashOrchestrator=N/A, Train Mode=DIRECT, Eval Mode=DIRECT2025.12 | 68.1 | 77.2 | 60.4 | 74.9 | 71.6 | 65.5 | |
| SAGEOrchestrator=SAGE-MM: Qwen3-VL-8B-Instruct [+SFT] [+RL], Train Mode=AGENT, Eval Mode=AGENT2025.12 | 68 | 82.6 | 55.6 | 75.4 | 82.8 | 64 | |
| SAGE-FlashOrchestrator=SAGE-MM: Molmo2-8B [+SFT] [+RL], Train Mode=AGENT, Eval Mode=AGENT2025.12 | 67.8 | 79.3 | 58.1 | 67.5 | 73.9 | 67.3 | |
| Qwen3-VL-30B-A3B-InstructOrchestrator=N/A, Train Mode=DIRECT, Eval Mode=DIRECT2025.12 | 67.6 | 81.3 | 55.8 | 72.8 | 71.6 | 65.4 | |
| SAGEOrchestrator=SAGE-MM: Molmo2-8B [+SFT] [+RL], Train Mode=AGENT, Eval Mode=AGENT2025.12 | 66.1 | 78.8 | 55.2 | 67.3 | 73.9 | 64.8 | |
| Qwen3-VL-8B-InstructOrchestrator=N/A, Train Mode=DIRECT, Eval Mode=DIRECT2025.12 | 64.9 | 77.7 | 54 | 72.8 | 68.7 | 61.9 | |
| SAGEOrchestrator=SAGE-MM: Qwen3-VL-4B-Instruct [+SFT], Train Mode=AGENT, Eval Mode=AGENT2025.12 | 64.6 | 77.3 | 53.7 | 66.2 | 67.2 | 63.7 | |
| SAGEOrchestrator=SAGE-MM: Qwen3-VL-8B-Instruct [+SFT], Train Mode=AGENT, Eval Mode=AGENT2025.12 | 63.9 | 77.4 | 52.4 | 72.3 | 74.6 | 60 | |
| SAGEOrchestrator=SAGE-MM: Qwen2.5-VL-7B-Instruct [+SFT] [+RL], Train Mode=AGENT, Eval Mode=AGENT2025.12 | 63.4 | 77.2 | 51.5 | 66.1 | 65.7 | 62.2 | |
| SAGEOrchestrator=SAGE-MM: Molmo2-8 [+SFT], Train Mode=AGENT, Eval Mode=AGENT2025.12 | 63.2 | 75.6 | 52.8 | 67 | 73.9 | 60.9 | |
| Qwen3-VL-4B-InstructOrchestrator=N/A, Train Mode=DIRECT, Eval Mode=DIRECT2025.12 | 62.7 | 75.8 | 51.6 | 69.3 | 66.4 | 60.2 | |
| Molmo2-8BOrchestrator=N/A, Train Mode=DIRECT, Eval Mode=DIRECT2025.12 | 61.8 | 77.9 | 48.1 | 66.8 | 64.2 | 60 | |
| SAGEOrchestrator=SAGE-MM: Qwen2.5-VL-7B-Instruct [+SFT], Train Mode=AGENT, Eval Mode=AGENT2025.12 | 61.1 | 74.1 | 50.1 | 62.9 | 69.4 | 59.6 | |
| Qwen2.5-VL-7B-InstructOrchestrator=N/A, Train Mode=DIRECT, Eval Mode=DIRECT2025.12 | 58.6 | 74.2 | 45.4 | 65.8 | 68.7 | 55.2 | |
| Video-R1-7BOrchestrator=N/A, Train Mode=DIRECT, Eval Mode=DIRECT2025.12 | 57.6 | 73.6 | 43.9 | 67.5 | 67.2 | 53.3 | |
| VideoRFT-7BOrchestrator=N/A, Train Mode=DIRECT, Eval Mode=DIRECT2025.12 | 55.3 | 71.6 | 41.4 | 65.2 | 67.2 | 50.7 | |
| VideoChat-R1.5Orchestrator=VideoChat-R1.5-7B-M, Train Mode=AGENT, Eval Mode=AGENT2025.12 | 54.8 | 73.8 | 38.6 | 55.1 | 48.5 | 55.1 | |
| LongVILA-R1-7BOrchestrator=N/A, Train Mode=DIRECT, Eval Mode=DIRECT2025.12 | 52.6 | 68.8 | 38.7 | 57.6 | 64.9 | 49.6 | |
| VideoExplorerOrchestrator=VideoExplorer-7B-Planner, Train Mode=AGENT, Eval Mode=AGENT2025.12 | 50.1 | 69.6 | 35.1 | 52 | 40.2 | 51.3 | |
| VideoMindOrchestrator=VideoMind-7B-Planner, Train Mode=AGENT, Eval Mode=AGENT2025.12 | 50 | 69.7 | 33.2 | 50.8 | 41.8 | 50.7 | |
| LVAgentOrchestrator=InternVL-8/72B [7] + LLaVA-Video-72B [59], Train Mode=N/A, Eval Mode=AGENT2025.12 | 49.7 | 70.5 | 32.1 | 54.1 | 48.5 | 48.4 | |
| LongVTOrchestrator=LongVT-7B-RFT, Train Mode=AGENT, Eval Mode=AGENT2025.12 | 46.7 | 68.2 | 28.4 | 51 | 37.3 | 46.4 | |
| VideoAgentOrchestrator=GPT-4o, Train Mode=N/A, Eval Mode=AGENT2025.12 | 42 | 52.6 | 32.9 | 42.6 | 29.1 | 43.2 | |
| Video-Thinker-7BOrchestrator=N/A, Train Mode=DIRECT, Eval Mode=DIRECT2025.12 | 41.3 | 70.1 | 16.8 | 48.2 | 41.8 | 39 |