ChaosNLI
Benchmarks
TaskDatasetSOTA resultTrendResults
ChaosNLI S easy (test)
62.4Top-1 Accuracy
27
ChaosNLI S_amb (test)
41.8Top-1 Accuracy
27
ChaosNLI (test)
50.5Top-1 Accuracy
27
ChaosNLI combined SNLI+MNLI K=3
2.15ECE
26
ChaosNLI (500 held-out pairs)
0.82Spearman Rho
16
ChaosNLI
0KL Divergence
12
ChaosNLI 1.0 (test)
0KL Div (Dist)
8
ChaosNLI 1.0 (dev)
0.073KL Divergence (BERT FT)
8
ChaosNLI-S
0.191JSD
4
ChaosNLI-M
0.173JSD
4
ChaosNLI
0.181JSD
4
ChaosNLI (test)
0.06KL Divergence
4
ChaosNLI (test)
91Conditional Saturation
3