ANLI
Benchmarks
TaskDatasetSOTA resultTrendResults
ANLI
74.02Accuracy
107
ANLI Round 3
67.9Accuracy
64
ANLI Round 2
66.5Accuracy
64
ANLI Round 1
77Accuracy
57
aNLI (test)
92.9Accuracy
53
aNLI (leaderboard)
93.2Accuracy
47
aNLI
87.3Accuracy
35
ANLI R2
81.14Accuracy
32
ANLI R3 1.0 (test)
34.9Weighted F1
28
ANLI R2 1.0 (test)
0.331Weighted F1
28
ANLI R1 1.0 (test)
41.1Weighted F1
28
ANLI (test)
92.2Overall Score
28
ANLI
73.1ANLI R1 Accuracy
27
ANLI R3 (test)
44.7Accuracy
26
ANLI R1 (test)
44.3Accuracy
26
ANLI (val)
73.37Accuracy
21
ANLI R2 (test)
33.1Accuracy
20
ANLI R3
46.67Accuracy
16
ANLI Round 2 (test)
51.4Accuracy
14
ANLI (dev)
76.4R1 Score
13
ANLI
79.4Best-of-K Accuracy
8
ANLI 1
36.4Accuracy (ANLI 1)
8
ANLI
75Best F1 (ANLI)
8
ANLI R1
47.3Accuracy
8
ANLI MNLI + SNLI trained (test)
50ANLI A1 Score
8