General video understanding on PerceptionTest (PercTest)
82.7AccuracyPLM-7B
Evaluation results
| Method | Links | |
|---|---|---|
| PLM-7B2026.06 | 82.7 | |
| Molmo2-8B2026.06 | 82.1 | |
| Eagle-X5-7B2026.06 | 81 | |
| AdaCodecToken budget=comparable, Backbone=Qwen2-VL-7B2026.06 | 80.5 | |
| Molmo2-O-7B2026.06 | 79.6 | |
| GPT-4o2026.06 | 79.4 | |
| Gemini 1.5 ProSource=[60]2026.06 | 78.4 | |
| Gemini 1.5 ProSource=[59]2026.06 | 77.6 | |
| VideoChat-Flash-7B2026.06 | 76.5 | |
| AdaCodecToken budget=1/7, Backbone=Qwen2-VL-7B2026.06 | 75.1 | |
| Gemini 1.5 Flash2026.06 | 74.7 | |
| GLM-4V-9B2026.06 | 74.2 | |
| InternVL2-8B2026.06 | 72.7 | |
| Qwen2-VL-7B2026.06 | 72.7 | |
| GPT-4o mini2026.06 | 72 | |
| MiniCPM-V-2.6-8B2026.06 | 70.9 | |
| CoPE-VideoLM-7B2026.06 | 70.3 | |
| LLaVA-Video-7B2026.06 | 68.8 | |
| ReMoRa-7B2026.06 | 67.7 | |
| Claude 3.5 Sonnet2026.06 | 64.3 | |
| Key-VL-1.5-8B2026.06 | 64.2 |