Visual Question Answering on VQA Counterexamples v1 (val)
32.8AccuracyLMH
Evaluation results
| Method | Links | |
|---|---|---|
| LMHBase Architecture=UpDown [3], Evaluation Protocol=VQA-CE2021.04 | 32.8 | |
| LfFBase Architecture=UpDown [3], Evaluation Protocol=VQA-CE2021.04 | 32.05 | |
| UpDownEvaluation Protocol=VQA-CE2021.04 | 31.71 | |
| ESRBase Architecture=UpDown [3], Evaluation Protocol=VQA-CE2021.04 | 31.5 | |
| LMH + RMFEBase Architecture=UpDown [3], Evaluation Protocol=VQA-CE2021.04 | 31.09 | |
| RandImgBase Architecture=UpDown [3], Evaluation Protocol=VQA-CE2021.04 | 31.09 | |
| SANVisual Features=grid features, Evaluation Protocol=VQA-CE2021.04 | 26.09 | |
| RUBiBase Architecture=UpDown [3], Evaluation Protocol=VQA-CE2021.04 | 23.87 | |
| Question-OnlyEvaluation Protocol=VQA-CE2021.04 | 13.48 | |
| Image-OnlyEvaluation Protocol=VQA-CE2021.04 | 1.75 | |
| ShortcutsEvaluation Protocol=VQA-CE2021.04 | 0.05 |