Video Understanding on DREAM-1K
42.7F1-ScoreGemini 2.5 Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini 2.5 ProModel Class=Closed-source Models2026.06 | 42.7 | |
| Gemini 3 ProModel Class=Closed-source Models2026.06 | 42.5 | |
| GPT-5.2Model Class=Closed-source Models2026.06 | 42.2 | |
| Qwen3-VL-8B + MotionAtlas-DataModel Class=Open-source Models, Training Data=MotionAtlas-Data2026.06 | 39.6 | |
| Qwen3-VL-4B + MotionAtlas-DataModel Class=Open-source Models, Training Data=MotionAtlas-Data2026.06 | 38.9 | |
| Qwen3-VL-8BModel Class=Open-source Models2026.06 | 38.7 | |
| Qwen3-VL-4BModel Class=Open-source Models2026.06 | 35.6 | |
| Molmo2-8B + MotionAtlas-DataModel Class=Open-source Models, Training Data=MotionAtlas-Data2026.06 | 34 | |
| Molmo2-4B + MotionAtlas-DataModel Class=Open-source Models, Training Data=MotionAtlas-Data2026.06 | 32.7 | |
| Molmo2-8BModel Class=Open-source Models2026.06 | 29.6 | |
| Molmo2-4BModel Class=Open-source Models2026.06 | 25.7 |