BLiMP
Benchmarks
TaskDatasetSOTA resultTrendResults
BLiMP
88.9Overall Accuracy
49
BLiMP (test)
100NPI lic. (2)
28
BLiMP 10% (test)
76.1BLiMP 10% Accuracy
11
BLiMP
81.5Accuracy
10
BLiMP
64.8Performance
10
BLiMP English (all)
81.6Accuracy
9
BLiMP-NL Dutch (test)
73AUC
8
BLiMP
84.61Accuracy
8
sBLIMP
64.7Accuracy
8
BLiMP (test)
79.6Accuracy
8
BLiMP (test)
0.773BLiMP Accuracy
8
BLiMP
82.03Accuracy
6
BLiMP
76.4BLiMP Grammaticality Score
6
BLiMP
80.1Accuracy
6
BLIMP Animacy
78.7Accuracy
6
BLIMP Det-Noun
99.9Accuracy
6
BLIMP Subject-Verb
97.1Accuracy
6
BLiMP Epoch 2
82.3BLiMP Accuracy (Epoch 2)
5
BLiMP Epoch 1
81BLiMP Grammaticality Judgment (Epoch 1)
5
BLiMP 10% subset
83.2Accuracy (10% BLiMP)
3
BLiMP principle_A_c_command
50.4Accuracy
3
BLiMP coordinate_structure_constraint_complex_left_branch
62.4Accuracy
3
BLiMP left branch island echo question
63.2Accuracy
3
BLiMP sentential_subject_island
52.2Accuracy
3
BLiMP principle_A_reconstruction
78.9Accuracy
3