Video In-Context Learning on Demo-ICL-Bench (test)
54.4T ICL ScoreGemini-2.5-Pro
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Gemini-2.5-ProSize=-2026.02 | 54.4 | 36.2 | 26 | 38.9 | |
| VideoRAGSize=-2026.02 | 52.6 | 22.8 | 18 | 31.3 | |
| GPT-4oSize=-2026.02 | 48.8 | 31.4 | 24.5 | 34.9 | |
| Demo-ICLSize=7B2026.02 | 43.4 | 32 | 24 | 33.1 | |
| VideoAgentSize=-2026.02 | 36.2 | 23.4 | 17.5 | 25.7 | |
| VideoChat-R1Size=7B2026.02 | 34.4 | 28.2 | 18.5 | 27 | |
| Video-R1Size=7B2026.02 | 33.6 | 27.4 | 17.5 | 26.2 | |
| Qwen2.5-VLSize=7B2026.02 | 32.8 | 28 | 18 | 26.3 | |
| OlaSize=7B2026.02 | 32.2 | 24.6 | 16 | 24.3 | |
| InternVL-3Size=8B2026.02 | 31.4 | 27 | 16.5 | 25 | |
| LLaVA-VideoSize=7B2026.02 | 31 | 30.2 | 20.5 | 27.2 | |
| Qwen2-VLSize=7B2026.02 | 29 | 22.4 | 14.5 | 22 |