Time-related video understanding on E.T. Bench
61.9REF ScoreMUSEG-7B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MUSEG-7BCategory=Open-source ~ 7B Models2025.05 | 61.9 | 37.5 | 23.7 | 24 | 36.8 | |
| TimeZeroCategory=Open-source ~ 7B Models2025.05 | 55.9 | 35.8 | 21.4 | 17.1 | 32.6 | |
| VideoChat-R1Category=Open-source ~ 7B Models2025.05 | 55.8 | 35.6 | 22.1 | 19.5 | 33.3 | |
| Qwen2.5-VL-7B + vanilla GRPOCategory=Open-source ~ 7B Models, Training=vanilla GRPO2025.05 | 54.4 | 37.6 | 23.5 | 20.6 | 34 | |
| MUSEG-3BCategory=Open-source ~ 3B Models2025.05 | 53.9 | 30 | 18.7 | 8.8 | 27.9 | |
| Qwen2.5-VL-7BCategory=Open-source ~ 7B Models2025.05 | 53.1 | 30.7 | 16.2 | 11.3 | 27.8 | |
| Qwen2.5-VL-3BCategory=Open-source ~ 3B Models2025.05 | 51.7 | 20.4 | 13.6 | 8 | 23.4 | |
| Video-R1Category=Open-source ~ 7B Models2025.05 | 50.3 | 25.3 | 15.6 | 12.4 | 25.9 | |
| TEMPURACategory=Open-source ~ 3B Models2025.05 | 46.3 | 26.1 | 14.4 | 10.2 | 24.3 | |
| E.T. ChatCategory=Open-source ~ 7B Models2025.05 | 38.4 | 38 | 16.7 | 13.5 | 26.7 | |
| TRACE-7BCategory=Open-source ~ 7B Models2025.05 | 33.6 | 33.8 | 20.3 | 25.8 | 28.4 | |
| Qwen2.5-VL-7B + vanilla SFTCategory=Open-source ~ 7B Models, Training=vanilla SFT2025.05 | 24.3 | 11.3 | 15.3 | 6.6 | 14.4 |