AI2D
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
AI2D (test)
55.44Accuracy
16
AI2D
86.5Pass@1 Accuracy
16
AI2D
83.44Score
16
AI2D
80.8Accuracy
16
AI2D
87.7Score
15
AI2D (test)
85Accuracy
14
AI2D
86.5Accuracy
13
AI2D (test)
87.5Score
13
AI2D (val)
84AI2D Accuracy
13
AI2D (test)
91.5Score
12
AI2D
84.1Accuracy
11
AI2D
79.92Accuracy
10
AI2D
85.3Score
10
AI2D
85.9Score
10
AI2D 2016 (test)
89.2Score
9
AI2D
71.9Score
9
AI2D
81.3Score
9
AI2D w/o M
81.6Accuracy
9
AI2D no mask
94.46Score
9
AI2D
65.38Score
7
AI2D
81.4AI2D Score
7
AI2D
78.2Avg@8
7
AI2D w mask
88.9Score
7
AI2D
76.2Score
7
AI2D
86.7Score
7