EntailmentBank
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
EntailmentBank (test)
67BLEU
26
EntailmentBank (test)
54BLEU
20
ENTAILMENTBANK
0.177Somers' D
15
EntailmentBank
25.33Initial Score
15
EntailmentBank
57BLEU
12
EntailmentBank Task 3 (Full Unseen)
47.1Leaves F1
10
EntailmentBank
0.789Spearman Correlation
9
EntailmentBank Task 2 (Distractors)
90.3Leaves F1
6
EntailmentBank Task 1 (No Distractors)
100Leaves F1
6
EntailmentBank (test)
45.6Leaves F1
5
EntailmentBank 50 samples (test)
100FV
4
EntailmentBankQA Easy (test)
70.8Answer Accuracy
3
EntailmentBank
81.8Accuracy
2