Instruction-Following Video Captioning on IF-VidCap
74.53CSRGemini-2.5-Pro
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Gemini-2.5-Pro2026.06 | 74.53 | 27.83 | 87.81 | 74.35 | 59 | 35.22 | |
| OmniCaptioner-IF-7BAudio Configuration=w/o Audio2026.06 | 61.2 | 12.21 | 79.92 | 61.33 | 40.63 | 16.57 | |
| Qwen2.5-VL-Instruct-7B2026.06 | 58.12 | 10.92 | 73.81 | 52.51 | 39.65 | 18.75 | |
| OmniCaptioner-IF-3BAudio Configuration=w/o Audio2026.06 | 57.56 | 8.7 | 76.3 | 57.58 | 36.99 | 13.7 | |
| Qwen2.5-Omni-7BAudio Configuration=w/o Audio2026.06 | 56.49 | 8.17 | 74.41 | 54.12 | 36.76 | 14.04 | |
| Qwen2.5-VL-Instruct-3B2026.06 | 51.74 | 6.54 | 66.5 | 43.46 | 34.47 | 13.15 | |
| Qwen2.5-Omni-3BAudio Configuration=w/o Audio2026.06 | 49.66 | 5.73 | 65.77 | 43.23 | 31.95 | 11.1 |