VisDial
Benchmarks
TaskDatasetSOTA resultTrendResults
VisDial v0.9 (val)
69.35MRR
141
VisDial v1.0 (test-std)
75.13NDCG
98
VisDial 1.0 (val)
0.695MRR
75
VisDial v0.9 (test)
64.1MRR
58
VisDial v1.0 (test-standard)
67.25MRR
51
VisDial
62.27MRR
36
VisDial 0.5 (test)
0.635MRR
27
VisDial v1.0 (test)
75.2NDCG
26
VisDial (test)
49.29Avg R
12
VisDial
70.9VisDial Accuracy
10
VisDial (test)
45.9MRR
9
VisDial 1.0 (test)
0.645CLIP Similarity
9
VisDial (val)
75.4NDCG
9
VisDial v0.5 (test)
63.5MRR
7
VisDial (val)
29.53Hits@1 (R1)
6
VisDial
0.511NDCG
5
VisDial (val)
62.08RAD (Y/N <- C)
2
VisDial v1.0 (val)
68.99Y/N Accuracy (C)
2
VisDial (val)
3.41#ARNSR
2
VisDial (test-std)
75.4NDCG
2
VisDial v0.9 (val)
0.414MRR
2