ContractNLI
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ContractNLI
87.03CQ
25
ContractNLI re-annotated (test)
83Accuracy
20
ContractNLI
79.9Performance
18
ContractNLI
84.5Macro-F1
8
ContractNLI
4.04Expected Calibration Error (ECE)
6
ContractNLI
57.8NLI Score
5
ContractNLI
84.9mF1
5
ContractNLI SCROLLS (test)
59.38Exact Match (EM)
3