Visual Dialog on VisDial 1.0 (val)

0.6951MRRGST (Student)

Evaluation Results

Method
GST (Student)2022.05	0.6951	—	—	—	—	65.92
BLIP2022.01	0.6941	56.44	85.9	93.3	3.2	—
BLIP2022.05	0.6941	—	—	—	—	—
VD-ViLBERT†2022.01	0.691	55.88	85.5	93.29	3.25	—
UTC2022.05	0.6858	55.48	85.38	93.2	3.28	0.6322
VD-BERT2022.01	0.6744	54.02	83.96	92.33	3.53	—
VDBERT2022.05	0.6744	54.02	83.96	92.33	3.53	0.6322
VisDial-BERT2022.05	0.6717	53.42	84.41	92.62	3.41	0.6096
ReDAN2019.11	0.6421	50.6	81.39	90.26	4.05	0.5932
ReDAN2022.05	0.6421	50.6	81.39	90.26	4.05	0.5932
ReDAN2026.05	0.6421	50.6	81.39	90.26	4.05	0.5932
HCIAE2019.11	0.6296	48.94	80.5	89.66	4.24	0.5775
HCIAE2022.05	0.6296	48.94	80.5	89.66	4.24	0.5775
HCIAE2026.05	0.6296	48.94	80.5	89.66	4.24	0.5775
CoAtt2019.11	0.6291	48.86	80.41	89.83	4.21	0.5772
CoAtt2022.05	0.6291	48.86	80.41	89.83	4.21	0.5772
CoAtt2026.05	0.6291	48.86	80.41	89.83	4.21	0.5772
LTMI2019.11	0.6232	48.94	78.65	87.88	4.86	0.6272
LTMI2022.05	0.6232	48.94	78.65	87.88	4.86	0.6272
LTMI2026.05	0.6232	48.94	78.65	87.88	4.86	0.6272
ACE2019.09	0.62	47	82.4	92.3	3.81	0.53
PDUN2019.09	0.62	47.3	82.5	92.6	3.68	0.54
NMN2019.09	0.61	47.5	78.1	88.8	4.4	0.54
MN2019.11	0.6042	46.09	78.14	88.05	4.63	0.5513
MN2022.05	0.6042	46.09	78.14	88.05	4.63	0.5513
MN2026.05	0.6042	46.09	78.14	88.05	4.63	0.5513
ECE2019.09	0.58	43.6	75.4	85.3	5.36	0.49
MN2019.09	0.56	42.4	74	84.3	5.59	0.47
LF2019.09	0.55	40.9	72.4	82.8	5.95	0.45
HRE2019.09	0.54	39.9	70.4	81.5	6.41	0.45
V²Dial2025.03	0.532	46.1	59.3	65.7	—	0.531
Student2022.05	0.5319	43.08	64.09	71.51	14.34	0.6547
UTC2022.05	0.5222	42.56	62.4	69.51	15.67	0.6386
UTC2022.05	0.5222	42.56	62.4	69.51	15.67	0.6386
LTMI-LG2025.03	0.513	41.3	61.6	69	—	0.632
GOG2025.03	0.513	41.2	61.8	—	—	0.626
MITVG2022.05	0.5114	41.03	61.25	68.49	14.37	0.6147
V²Dial2025.03	0.509	45.4	54.7	61.1	—	0.54
LTMI2019.11	0.5074	40.44	61.61	69.71	14.93	0.6358
LTMI2022.05	0.5074	40.44	61.61	69.71	14.93	0.6358
LTMI2022.05	0.5074	40.44	61.61	69.71	14.93	0.6358
LTMI2026.05	0.5074	40.44	61.61	69.71	14.93	0.6358
LTMI2025.03	0.507	40.4	61.6	69.7	—	0.635
UTC2025.03	0.506	41.3	59.8	69.4	—	0.61
DAM2022.05	0.5051	40.53	60.84	67.94	16.65	0.6093
DMRM2022.05	0.5016	40.15	60.02	67.21	15.19	—
KBGN2022.05	0.5005	40.4	60.11	66.82	17.54	0.6042
ReDAN2019.11	0.5002	40.27	59.93	66.78	17.4	0.6047
ReDAN2022.05	0.5002	40.27	59.93	66.78	17.4	0.6047
ReDAN2022.05	0.5002	40.27	59.93	66.78	17.4	0.6047
ReDAN2026.05	0.5002	40.27	59.93	66.78	17.4	0.6047
CoAtt2019.11	0.4964	40.09	59.37	65.92	17.86	0.5924
CoAtt2022.05	0.4964	40.09	59.37	65.92	17.86	0.5924
CoAtt2022.05	0.4964	40.09	59.37	65.92	17.86	0.5924
CoAtt2026.05	0.4964	40.09	59.37	65.92	17.86	0.5924
HCIAE2019.11	0.4907	39.72	58.23	64.73	18.43	0.597
HCIAE2022.05	0.4907	39.72	58.23	64.73	18.43	0.597
HCIAE2022.05	0.4907	39.72	58.23	64.73	18.43	0.597
HCIAE2026.05	0.4907	39.72	58.23	64.73	18.43	0.597
Primary2022.05	0.4901	38.54	59.82	66.94	16.6	—
MN2022.05	0.4799	38.18	57.54	64.32	18.6	0.5186
MN2019.11	0.4783	38.01	57.49	64.08	18.76	0.5699
MN2022.05	0.4783	38.01	57.49	64.08	18.76	0.5699
MN2026.05	0.4783	38.01	57.49	64.08	18.76	0.5699
MST-MIXER2025.03	0.477	42.2	51.6	57.8	—	0.525
V²Dial2025.03	0.327	22.1	41.2	48.1	—	0.32
V²Dial2025.03	0.269	20	30.2	39.3	—	0.333
ESPER2025.03	0.257	14.6	—	—	—	0.223
Champagne2025.03	0.255	—	—	—	—	0.196
VideoChat22025.03	0.223	12.7	29	39.9	—	0.309
FROMAGE2025.03	0.22	17.6	20.1	25.1	—	0.165
MST-MIXER2025.03	0.219	18.2	22.1	25.7	—	0.246
MOE-LLAVA2025.03	0.207	10.6	25.4	36.4	—	0.267
Video-ChatGPT2025.03	0.181	10	22.5	31.5	—	0.248
MiniGPT-video2025.03	0.146	7.4	17.4	26.5	—	0.232
Champagne/CC2025.03	—	—	—	66.3	—	0.625