Open-Ended Visual Question Answering on VQA 1.0 (test-standard)
67.36Overall AccuracyMUTAN
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MUTANEnsemble size=52017.05 | 67.36 | 84.91 | — | 58.35 | 39.79 | |
| MUTANEnsemble size=32017.05 | 66.96 | 84.39 | — | 58.2 | 38.7 | |
| MLBEnsemble size=72017.05 | 66.89 | 84.61 | — | 57.79 | 39.07 | |
| MCBEnsemble size=72017.05 | 66.5 | 83.2 | — | 58 | 39.5 | |
| Dual-MFA2017.11 | 66.09 | 83.37 | — | 56.89 | 40.39 | |
| MLB2017.11 | 65.07 | 84.02 | — | 54.77 | 37.9 | |
| OursBackbone=ResNet2017.04 | 64.6 | 82 | — | 55.2 | 39.1 | |
| DANBackbone=ResNet2016.11 | 64.2 | 82.8 | 38.1 | 54 | — | |
| DANBackbone=ResNet2017.04 | 64.2 | 82.8 | — | 54 | 38.1 | |
| VQA-Machine2017.11 | 63.3 | 81.4 | — | 53.2 | 38.2 | |
| RAUBackbone=ResNet2016.11 | 63.2 | 81.7 | 38.2 | 52.8 | — | |
| RAUBackbone=ResNet2017.04 | 63.2 | 81.7 | — | 52.8 | 38.2 | |
| HieCoAttBackbone=ResNet2016.11 | 62.1 | — | — | — | — | |
| HieCoAttBackbone=ResNet2017.04 | 62.1 | — | — | — | — | |
| HieCoAtt2017.05 | 62.1 | — | — | — | — | |
| HieCoAtt2017.11 | 62.06 | 79.95 | — | 51.95 | 38.22 | |
| MRN2017.05 | 61.84 | 82.39 | — | 49.41 | 38.23 | |
| MRN2017.11 | 61.84 | 82.39 | — | 49.41 | 38.23 | |
| MRNBackbone=ResNet2016.11 | 61.8 | 82.4 | 38.2 | 49.4 | — | |
| MRNBackbone=ResNet2017.04 | 61.8 | 82.4 | — | 49.4 | 38.2 | |
| QRU2017.11 | 60.76 | — | — | — | — | |
| DMN+2016.11 | 60.4 | — | — | — | — | |
| DMN+Backbone=VGG2017.04 | 60.4 | — | — | — | — | |
| DMN+2017.11 | 60.36 | 80.43 | — | 48.33 | 36.82 | |
| FDA2017.11 | 59.54 | 81.34 | — | 46.1 | 35.67 | |
| ACK2017.05 | 59.44 | 81.07 | — | 45.83 | 37.12 | |
| ACK2016.11 | 59.4 | 81.1 | 37.1 | 45.8 | — | |
| ACKBackbone=VGG2017.04 | 59.4 | 81.1 | — | 45.8 | 37.1 | |
| D-NMN2017.05 | 59.4 | — | — | — | — | |
| SAN2016.11 | 58.9 | — | — | — | — | |
| SANBackbone=VGG2017.04 | 58.9 | — | — | — | — | |
| SAN2017.05 | 58.9 | — | — | — | — | |
| SAN2017.11 | 58.85 | 79.11 | — | 46.42 | 36.41 | |
| NMN2016.11 | 58.7 | — | — | — | — | |
| NMNBackbone=VGG2017.04 | 58.7 | — | — | — | — | |
| Ask Your Neur.2017.05 | 58.43 | 78.24 | — | 46.32 | 36.27 | |
| SMem 2-hop2017.05 | 58.24 | 80 | — | 43.48 | 37.53 | |
| SMem2017.11 | 58.24 | 80.8 | — | 43.48 | 37.53 | |
| VQA team2016.11 | 58.2 | 80.6 | 36.5 | 43.7 | — | |
| VQA team2017.04 | 58.2 | 80.6 | — | 43.7 | 36.5 | |
| DPPnet2016.11 | 57.4 | 80.3 | 36.9 | 42.2 | — | |
| DPPnet2017.11 | 57.36 | 80.28 | — | 42.24 | 36.92 | |
| DPPnet2015.12 | 57.36 | 80.28 | — | 42.24 | 36.92 | |
| ACK2015.12 | 55.98 | 79.05 | — | 40.61 | 36.1 | |
| iBOWIMG2016.11 | 55.9 | 76.8 | 35 | 42.6 | — | |
| iBOWING2017.11 | 55.89 | 76.76 | — | 42.62 | 34.98 | |
| iBOWIMG2015.12 | 55.89 | 76.76 | — | 42.62 | 34.98 | |
| NMN+LSTM2015.12 | 55.1 | — | — | — | — | |
| LSTM Q+I2017.11 | 54.06 | 79.01 | — | 36.8 | 35.55 | |
| LSTMIMG2015.12 | 54.06 | — | — | — | — |