Robotic Video Question Answering on RoboVQA (test)
72.7BLEU-1Thinker-7B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Thinker-7BParameters=7B2026.01 | 72.7 | 65.7 | 59.5 | 56 | 63.5 | |
| RoboBrain-7BParameters=7B2026.01 | 72.05 | 65.35 | 59.39 | 55.05 | 62.7 | |
| ThinkAct-7BParameters=7B2026.01 | 69.1 | 61.8 | 56 | 52.4 | 59.8 | |
| Qwen2.5-VL-7BParameters=7B2026.01 | 62.2 | 54.6 | 48.7 | 45 | 52.6 | |
| RoboBrain2-7BParameters=7B2026.01 | 37.4 | 31 | 27.1 | 25.8 | 30 | |
| GPT-4V2026.01 | 32.2 | 26.5 | 24.7 | 23.9 | 26.8 |