NLVR2
Benchmarks
TaskDatasetSOTA resultTrendResults
NLVR2 (test-p)
92.6Accuracy
346
NLVR2 (dev)
91.51Accuracy
307
NLVR2
92.6Accuracy
58
NLVR2 (test)
85.15Accuracy
46
NLVR2
88.8Accuracy
41
NLVR2
67.51Attack Success Rate
37
NLVR2 (dev)
82.5Accuracy
21
NLVR2 (test-P)
92.6Accuracy
21
NLVR2 (val)
91.1Accuracy
20
NLVR2 v2 (dev)
88.7Accuracy
20
NLVR2 (test)
85.36Accuracy
16
NLVR2 std
85.5Accuracy
14
NLVR2 (test-dev)
79.87Accuracy
14
NLVR2
90.42Accuracy
12
NLVR2 (val)
83.15Accuracy
12
NLVR2 (test)
87.3Accuracy
9
NLVR2 loc (val)
77.27Accuracy
5
NLVR2
20.01GFLOPs
4
NLVR2
17.4GFLOPs
4
NLVR2 (test-u)
67.3Accuracy
2