Visual Dialog on VisDial 1.0 (val)
0.6951MRRGST (Student)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GST (Student)Pre-train # Images=6.7M2022.05 | 0.6951 | — | — | — | — | 65.92 | |
| BLIPevaluation_protocol=discriminative2022.01 | 0.6941 | 56.44 | 85.9 | 93.3 | 3.2 | — | |
| BLIPPre-train # Images=129M2022.05 | 0.6941 | — | — | — | — | — | |
| VD-ViLBERT†evaluation_protocol=discriminative, pre-training=ViLBERT with additional VQA data2022.01 | 0.691 | 55.88 | 85.5 | 93.29 | 3.25 | — | |
| UTCsetting=discriminative2022.05 | 0.6858 | 55.48 | 85.38 | 93.2 | 3.28 | 0.6322 | |
| VD-BERTevaluation_protocol=discriminative2022.01 | 0.6744 | 54.02 | 83.96 | 92.33 | 3.53 | — | |
| VDBERTsetting=discriminative2022.05 | 0.6744 | 54.02 | 83.96 | 92.33 | 3.53 | 0.6322 | |
| VisDial-BERTsetting=discriminative2022.05 | 0.6717 | 53.42 | 84.41 | 92.62 | 3.41 | 0.6096 | |
| ReDANDecoder Type=Discriminative2019.11 | 0.6421 | 50.6 | 81.39 | 90.26 | 4.05 | 0.5932 | |
| ReDANsetting=discriminative2022.05 | 0.6421 | 50.6 | 81.39 | 90.26 | 4.05 | 0.5932 | |
| ReDANDecoder Type=Discriminative2026.05 | 0.6421 | 50.6 | 81.39 | 90.26 | 4.05 | 0.5932 | |
| HCIAEDecoder Type=Discriminative2019.11 | 0.6296 | 48.94 | 80.5 | 89.66 | 4.24 | 0.5775 | |
| HCIAEsetting=discriminative2022.05 | 0.6296 | 48.94 | 80.5 | 89.66 | 4.24 | 0.5775 | |
| HCIAEDecoder Type=Discriminative2026.05 | 0.6296 | 48.94 | 80.5 | 89.66 | 4.24 | 0.5775 | |
| CoAttDecoder Type=Discriminative2019.11 | 0.6291 | 48.86 | 80.41 | 89.83 | 4.21 | 0.5772 | |
| CoAttsetting=discriminative2022.05 | 0.6291 | 48.86 | 80.41 | 89.83 | 4.21 | 0.5772 | |
| CoAttDecoder Type=Discriminative2026.05 | 0.6291 | 48.86 | 80.41 | 89.83 | 4.21 | 0.5772 | |
| LTMIDecoder Type=Discriminative2019.11 | 0.6232 | 48.94 | 78.65 | 87.88 | 4.86 | 0.6272 | |
| LTMIsetting=discriminative2022.05 | 0.6232 | 48.94 | 78.65 | 87.88 | 4.86 | 0.6272 | |
| LTMIDecoder Type=Discriminative2026.05 | 0.6232 | 48.94 | 78.65 | 87.88 | 4.86 | 0.6272 | |
| ACE2019.09 | 0.62 | 47 | 82.4 | 92.3 | 3.81 | 0.53 | |
| PDUN2019.09 | 0.62 | 47.3 | 82.5 | 92.6 | 3.68 | 0.54 | |
| NMN2019.09 | 0.61 | 47.5 | 78.1 | 88.8 | 4.4 | 0.54 | |
| MNDecoder Type=Discriminative2019.11 | 0.6042 | 46.09 | 78.14 | 88.05 | 4.63 | 0.5513 | |
| MNsetting=discriminative2022.05 | 0.6042 | 46.09 | 78.14 | 88.05 | 4.63 | 0.5513 | |
| MNDecoder Type=Discriminative2026.05 | 0.6042 | 46.09 | 78.14 | 88.05 | 4.63 | 0.5513 | |
| ECE2019.09 | 0.58 | 43.6 | 75.4 | 85.3 | 5.36 | 0.49 | |
| MN2019.09 | 0.56 | 42.4 | 74 | 84.3 | 5.59 | 0.47 | |
| LF2019.09 | 0.55 | 40.9 | 72.4 | 82.8 | 5.95 | 0.45 | |
| HRE2019.09 | 0.54 | 39.9 | 70.4 | 81.5 | 6.41 | 0.45 | |
| V²DialSent. Trans.=OpenAI TE-3, trained_and_evaluated_by_authors=true2025.03 | 0.532 | 46.1 | 59.3 | 65.7 | — | 0.531 | |
| Student2022.05 | 0.5319 | 43.08 | 64.09 | 71.51 | 14.34 | 0.6547 | |
| UTCsetting=generative2022.05 | 0.5222 | 42.56 | 62.4 | 69.51 | 15.67 | 0.6386 | |
| UTC2022.05 | 0.5222 | 42.56 | 62.4 | 69.51 | 15.67 | 0.6386 | |
| LTMI-LGSent. Trans.=n/a2025.03 | 0.513 | 41.3 | 61.6 | 69 | — | 0.632 | |
| GOGSent. Trans.=n/a2025.03 | 0.513 | 41.2 | 61.8 | — | — | 0.626 | |
| MITVG2022.05 | 0.5114 | 41.03 | 61.25 | 68.49 | 14.37 | 0.6147 | |
| V²DialSent. Trans.=ROBERTA, trained_and_evaluated_by_authors=true2025.03 | 0.509 | 45.4 | 54.7 | 61.1 | — | 0.54 | |
| LTMIDecoder Type=Generative2019.11 | 0.5074 | 40.44 | 61.61 | 69.71 | 14.93 | 0.6358 | |
| LTMIsetting=generative2022.05 | 0.5074 | 40.44 | 61.61 | 69.71 | 14.93 | 0.6358 | |
| LTMI2022.05 | 0.5074 | 40.44 | 61.61 | 69.71 | 14.93 | 0.6358 | |
| LTMIDecoder Type=Generative2026.05 | 0.5074 | 40.44 | 61.61 | 69.71 | 14.93 | 0.6358 | |
| LTMISent. Trans.=n/a2025.03 | 0.507 | 40.4 | 61.6 | 69.7 | — | 0.635 | |
| UTCSent. Trans.=n/a2025.03 | 0.506 | 41.3 | 59.8 | 69.4 | — | 0.61 | |
| DAM2022.05 | 0.5051 | 40.53 | 60.84 | 67.94 | 16.65 | 0.6093 | |
| DMRM2022.05 | 0.5016 | 40.15 | 60.02 | 67.21 | 15.19 | — | |
| KBGN2022.05 | 0.5005 | 40.4 | 60.11 | 66.82 | 17.54 | 0.6042 | |
| ReDANDecoder Type=Generative2019.11 | 0.5002 | 40.27 | 59.93 | 66.78 | 17.4 | 0.6047 | |
| ReDANsetting=generative2022.05 | 0.5002 | 40.27 | 59.93 | 66.78 | 17.4 | 0.6047 | |
| ReDAN2022.05 | 0.5002 | 40.27 | 59.93 | 66.78 | 17.4 | 0.6047 | |
| ReDANDecoder Type=Generative2026.05 | 0.5002 | 40.27 | 59.93 | 66.78 | 17.4 | 0.6047 | |
| CoAttDecoder Type=Generative2019.11 | 0.4964 | 40.09 | 59.37 | 65.92 | 17.86 | 0.5924 | |
| CoAttsetting=generative2022.05 | 0.4964 | 40.09 | 59.37 | 65.92 | 17.86 | 0.5924 | |
| CoAttre-implemented=by [19]2022.05 | 0.4964 | 40.09 | 59.37 | 65.92 | 17.86 | 0.5924 | |
| CoAttDecoder Type=Generative2026.05 | 0.4964 | 40.09 | 59.37 | 65.92 | 17.86 | 0.5924 | |
| HCIAEDecoder Type=Generative2019.11 | 0.4907 | 39.72 | 58.23 | 64.73 | 18.43 | 0.597 | |
| HCIAEsetting=generative2022.05 | 0.4907 | 39.72 | 58.23 | 64.73 | 18.43 | 0.597 | |
| HCIAEre-implemented=by [19]2022.05 | 0.4907 | 39.72 | 58.23 | 64.73 | 18.43 | 0.597 | |
| HCIAEDecoder Type=Generative2026.05 | 0.4907 | 39.72 | 58.23 | 64.73 | 18.43 | 0.597 | |
| Primary2022.05 | 0.4901 | 38.54 | 59.82 | 66.94 | 16.6 | — | |
| MNre-implemented=by [19]2022.05 | 0.4799 | 38.18 | 57.54 | 64.32 | 18.6 | 0.5186 | |
| MNDecoder Type=Generative2019.11 | 0.4783 | 38.01 | 57.49 | 64.08 | 18.76 | 0.5699 | |
| MNsetting=generative2022.05 | 0.4783 | 38.01 | 57.49 | 64.08 | 18.76 | 0.5699 | |
| MNDecoder Type=Generative2026.05 | 0.4783 | 38.01 | 57.49 | 64.08 | 18.76 | 0.5699 | |
| MST-MIXERSent. Trans.=ROBERTA, trained_and_evaluated_by_authors=true2025.03 | 0.477 | 42.2 | 51.6 | 57.8 | — | 0.525 | |
| V²DialZero-shot=true, Sent. Trans.=OpenAI TE-32025.03 | 0.327 | 22.1 | 41.2 | 48.1 | — | 0.32 | |
| V²DialZero-shot=true, Sent. Trans.=ROBERTa2025.03 | 0.269 | 20 | 30.2 | 39.3 | — | 0.333 | |
| ESPERZero-shot=true, Sent. Trans.=n/a2025.03 | 0.257 | 14.6 | — | — | — | 0.223 | |
| ChampagneZero-shot=true, Sent. Trans.=n/a2025.03 | 0.255 | — | — | — | — | 0.196 | |
| VideoChat2Zero-shot=true, Sent. Trans.=ROBERTa2025.03 | 0.223 | 12.7 | 29 | 39.9 | — | 0.309 | |
| FROMAGEZero-shot=true, Sent. Trans.=n/a2025.03 | 0.22 | 17.6 | 20.1 | 25.1 | — | 0.165 | |
| MST-MIXERZero-shot=true, Sent. Trans.=ROBERTa2025.03 | 0.219 | 18.2 | 22.1 | 25.7 | — | 0.246 | |
| MOE-LLAVAZero-shot=true, Sent. Trans.=ROBERTa2025.03 | 0.207 | 10.6 | 25.4 | 36.4 | — | 0.267 | |
| Video-ChatGPTZero-shot=true, Sent. Trans.=ROBERTa2025.03 | 0.181 | 10 | 22.5 | 31.5 | — | 0.248 | |
| MiniGPT-videoZero-shot=true, Sent. Trans.=ROBERTa2025.03 | 0.146 | 7.4 | 17.4 | 26.5 | — | 0.232 | |
| Champagne/CCSent. Trans.=n/a2025.03 | — | — | — | 66.3 | — | 0.625 |