Open-ended counting on HowMany-QA (test)
0.64AccuracyMoVie
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MoVieBackbone=X-101, #params (M)=88.8, FLOPs (G)=706.32020.04 | 0.64 | 2.3 | |
| MoVieBackbone=R-50, #params (M)=25.6, FLOPs (G)=176.12020.04 | 0.612 | 2.36 | |
| TallyQABackbone=R-101+152, #params (M)=104.8, FLOPs (G)=1883.52020.04 | 0.603 | 2.35 | |
| IRLCBackbone=R-101, #params (M)=44.62020.04 | 0.561 | 2.45 | |
| Count moduleBackbone=R-101, #params (M)=44.62020.04 | 0.547 | 2.59 | |
| MUTANBackbone=R-152, #params (M)=60.22020.04 | 0.455 | 2.93 |