Visual Dialog Retrieval on VisDial v1.0 (test-standard)
67.25MRRTechnion
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Technion2019.02 | 67.25 | 53.4 | 85.28 | 92.7 | 3.55 | 54.46 | |
| DANmodel_setting=ensemble2019.02 | 64.92 | 51.28 | 81.6 | 90.88 | 3.92 | 59.36 | |
| HACANRPN=Yes2019.02 | 64.22 | 50.88 | 80.63 | 89.45 | 4.2 | 57.17 | |
| image-question-answer synergistic networkvariant=Ensemble, ensemble size=102019.02 | 63.42 | 49.3 | 80.77 | 90.68 | 3.97 | 57.88 | |
| Synergisticmodel_setting=ensemble2019.02 | 63.42 | 49.3 | 80.77 | 90.68 | 3.97 | 57.88 | |
| MS AI2019.02 | 63.27 | 49.53 | 80.4 | 89.6 | 4.15 | 55.35 | |
| MS ConvAImodel_setting=ensemble2019.02 | 63.27 | 49.53 | 80.4 | 89.6 | 4.15 | 55.35 | |
| DANRPN=Yes2019.02 | 63.2 | 49.63 | 79.75 | 89.35 | 4.3 | 57.59 | |
| DANmodel_setting=single2019.02 | 63.2 | 49.63 | 79.75 | 89.35 | 4.3 | 57.59 | |
| RvARPN=Yes2019.02 | 63.03 | 49.03 | 80.4 | 89.83 | 4.18 | 55.59 | |
| RvAevaluation_setting=discriminative, region_proposal_network=true, recursive_image_attention=true, visual_feature_filter=true2018.12 | 63.03 | 49.03 | 80.4 | 89.83 | 4.18 | 55.59 | |
| RvAmodel_setting=single2019.02 | 63.03 | 49.03 | 80.4 | 89.83 | 4.18 | 55.59 | |
| RvAevaluation_setting=discriminative, region_proposal_network=true, recursive_image_attention=true, visual_feature_filter=false2018.12 | 62.94 | 48.68 | 80.18 | 89.03 | 4.31 | 54.18 | |
| RvAevaluation_setting=discriminative, region_proposal_network=true, recursive_image_attention=false, visual_feature_filter=true2018.12 | 62.26 | 47.95 | 79.75 | 89.08 | 4.37 | 53.19 | |
| image-question-answer synergistic networkvariant=Single2019.02 | 62.2 | 47.9 | 80.43 | 89.95 | 4.17 | 57.32 | |
| SyncRPN=Yes2019.02 | 62.2 | 47.9 | 80.43 | 89.95 | 4.17 | 57.32 | |
| Synergisticmodel_setting=single2019.02 | 62.2 | 47.9 | 80.43 | 89.95 | 4.17 | 57.32 | |
| HACANRPN=No2019.02 | 61.74 | 47.91 | 78.59 | 87.81 | 4.63 | 52.81 | |
| CorefNMNBackbone=ResNet-1522018.09 | 61.5 | 47.55 | 78.1 | 88.8 | 4.4 | 54.7 | |
| CorefNMNRPN=No2019.02 | 61.5 | 47.55 | 78.1 | 88.8 | 4.4 | 54.7 | |
| CorefNMNevaluation_setting=discriminative, backbone=ResNet-1522018.12 | 61.5 | 47.55 | 78.1 | 88.8 | 4.4 | 54.7 | |
| CorefNMNmodel_setting=single2019.02 | 61.5 | 47.55 | 78.1 | 88.8 | 4.4 | 54.7 | |
| USTC-YTH2019.02 | 61.44 | 47.65 | 78.13 | 87.88 | 4.65 | 56.47 | |
| USTC-YTHmodel_setting=ensemble2019.02 | 61.44 | 47.65 | 78.13 | 87.88 | 4.65 | 56.47 | |
| visdial-gnn2019.04 | 61.37 | 47.33 | 77.98 | 87.83 | 4.57 | 52.82 | |
| RvARPN=No2019.02 | 60.6 | 46.25 | 77.88 | 87.83 | 4.65 | 51.76 | |
| RvAevaluation_setting=discriminative, region_proposal_network=false, recursive_image_attention=true, visual_feature_filter=true2018.12 | 60.6 | 46.25 | 77.88 | 87.83 | 4.65 | 51.76 | |
| LFRPN=Yes2019.02 | 60.41 | 46.18 | 77.8 | 87.3 | 4.75 | 51.63 | |
| NMNBackbone=ResNet-1522018.09 | 58.8 | 44.15 | 76.88 | 86.88 | 4.81 | 58.1 | |
| LF-att2019.02 | 57.07 | 42.08 | 74.83 | 85.05 | 5.41 | 49.76 | |
| LF-Att2019.04 | 57.07 | 42.08 | 74.82 | 85.05 | 5.41 | 49.76 | |
| MN-att2019.02 | 56.9 | 42.43 | 74 | 84.35 | 5.59 | 49.58 | |
| MN-Att2019.04 | 56.9 | 42.42 | 74 | 84.35 | 5.59 | 49.58 | |
| MN-QIH-DBackbone=VGG2018.09 | 55.5 | 40.98 | 72.3 | 83.3 | 5.92 | 47.5 | |
| MN2019.02 | 55.49 | 40.98 | 72.3 | 83.3 | 5.92 | 47.5 | |
| MNRPN=No2019.02 | 55.49 | 40.98 | 72.3 | 83.3 | 5.92 | 47.5 | |
| MNevaluation_setting=discriminative2018.12 | 55.49 | 40.98 | 72.3 | 83.3 | 5.92 | 47.5 | |
| MN2019.04 | 55.49 | 40.98 | 72.3 | 83.3 | 5.92 | 47.5 | |
| MNmodel_setting=single2019.02 | 55.49 | 40.98 | 72.3 | 83.3 | 5.92 | 47.5 | |
| LF2019.02 | 55.42 | 40.95 | 72.45 | 82.83 | 5.95 | 45.31 | |
| LFRPN=No2019.02 | 55.42 | 40.95 | 72.45 | 82.83 | 5.95 | 45.31 | |
| LFevaluation_setting=discriminative2018.12 | 55.42 | 40.95 | 72.45 | 82.83 | 5.95 | 45.31 | |
| LF2019.04 | 55.42 | 40.95 | 72.45 | 82.83 | 5.95 | 45.31 | |
| LFmodel_setting=single2019.02 | 55.42 | 40.95 | 72.45 | 82.83 | 5.95 | 45.31 | |
| LF-QIH-DBackbone=VGG2018.09 | 55.4 | 40.95 | 72.45 | 82.83 | 5.95 | 45.3 | |
| HRE-QIH-DBackbone=VGG2018.09 | 54.2 | 39.93 | 70.45 | 81.5 | 6.41 | 45.5 | |
| HRE2019.02 | 54.16 | 39.93 | 70.45 | 81.5 | 6.41 | 45.46 | |
| HRERPN=No2019.02 | 54.16 | 39.93 | 70.45 | 81.5 | 6.41 | 45.46 | |
| HREevaluation_setting=discriminative2018.12 | 54.16 | 39.93 | 70.45 | 81.5 | 6.41 | 45.46 | |
| HRE2019.04 | 54.16 | 39.93 | 70.45 | 81.5 | 6.41 | 45.46 | |
| HREmodel_setting=single2019.02 | 54.16 | 39.93 | 70.45 | 81.5 | 6.41 | 45.46 |