BLiMP
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
BLiMP matrix_question_npi_licensor_present
44.2Accuracy
3
BLiMP wh_vs_that_with_gap_long_distance
41.2Accuracy
3
BLiMP existential_there_quantifiers_2
51.8Accuracy
3
BLiMP only_npi_scope
69.4Accuracy
3
Blimp Circle C trajectory
0.96Computation Time (ms)
3
Blimp Helix B trajectory
0.95Computation Time (ms)
3
Blimp Helix A trajectory
0.94Computation Time (ms)
3
Blimp Lemniscate C trajectory
0.86Computation Time (ms)
3
Blimp Lemniscate B trajectory
0.87Computation Time (ms)
3
Blimp Lemniscate A trajectory
0.82Computation Time (ms)
3
Blimp Circle B trajectory
0.82Computation Time (ms)
3
Blimp Circle A trajectory
0.84Computation Time (ms)
3
Blimp (experimental trials)
1.25Avg CPU Energy Expenditure (µJ)
3
BLiMP
83Accuracy
3
BLiMP
80Accuracy
2