Winoground
Benchmarks
TaskDatasetSOTA resultTrendResults
Winoground
89.5Text Score
61
Winoground
64Text Alignment Score
44
Winoground
41.25Group Score
33
Winoground
89.5Text Agreement Score
26
Winoground 1.0 (test)
89.5Text Score
23
Winoground (test)
74Text Score
15
WinogroundVQA v1.0 (test)
46.5Accuracy
14
Winoground (test)
76.75Text Score
12
Winoground (test)
40Text Agreement (%)
12
Winoground (test)
89.5Text Score
12
Winoground
25.8Group Agreement
11
Winoground (test)
74Text Score
10
Winoground
59.88Simple Acc
9
Winoground
70.47Accuracy
8
Winoground
0.133R@1 (T2I)
8
Winoground standard (test)
75.5Text Score
7
Winoground
34Text Score
7
Winoground
14Image Score
7
Winoground (test)
61.3Text Score
7
Winoground
61.5Text Accuracy
5
Winoground 1.0 (full)
89.5Text Agreement Score
5
Winoground 400 pairs (test)
32.25Text Score
4
Winoground
30.5Text Score
4
Winoground Txt2Img
14Txt2Img Score
4
Winoground clean
52.63Text Agreement Score
4