Motion Quality Assessment on UltraVQA
81.5Acc@0.5ASO
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ASOModel Category=Ours, Protocol=Analytic Score Optimization2026.02 | 81.5 | 0.43 | 0.815 | 0.813 | |
| GRPOModel Category=Ours, Protocol=Group Relative Policy Optimization2026.02 | 81 | 0.446 | 0.806 | 0.801 | |
| SFTModel Category=Ours, Protocol=Supervised Fine-Tuning2026.02 | 71.7 | 0.622 | 0.694 | 0.71 | |
| VideoScoreV2Model Category=VQA Baselines2026.02 | 69.8 | 0.767 | 0.703 | 0.725 | |
| FineVQModel Category=VQA Baselines2026.02 | 61.3 | 0.789 | 0.691 | 0.685 | |
| Gemini-2.5ProModel Category=VLM-APIs2026.02 | 57 | 0.849 | 0.608 | 0.59 | |
| GPT-4.1Model Category=VLM-APIs2026.02 | 48 | 1.151 | 0.418 | 0.386 | |
| MiniCPMV-4.5Model Category=Open-source VLMs2026.02 | 46.8 | 1.157 | 0.413 | 0.425 | |
| InternVL-3.5Model Category=Open-source VLMs2026.02 | 41 | 1.466 | 0.205 | 0.243 | |
| VideoLLaMA3Model Category=Open-source VLMs2026.02 | 40.2 | 1.353 | 0.301 | 0.362 | |
| Qwen2.5-VLModel Category=Open-source VLMs2026.02 | 38 | 1.233 | 0.532 | 0.536 | |
| VideoChat-FlashModel Category=Open-source VLMs2026.02 | 36.4 | 1.468 | 0.124 | 0.144 | |
| InternVideo-2.5Model Category=Open-source VLMs2026.02 | 35.5 | 1.521 | 0.091 | 0.068 | |
| Q-AlignModel Category=VQA Baselines2026.02 | 34.4 | 1.466 | 0.26 | 0.261 |