CLINC150
Benchmarks
TaskDatasetSOTA resultTrendResults
CLINC150
88MAP
55
Clinc150 cross-domain
93.5Average Accuracy
38
Clinc150 (test)
95.72NMI
23
CLINC150
98.45Accuracy
17
CLINC150
72.36FAA Score
12
CLINC150 DialoGLUE 10-shot
95.58Accuracy
9
Clinc150 5-shot (test)
89.69Accuracy
8
CLINC150
96.9Accuracy (Pred)
6
CLINC150 75% known ratio (test)
0.877Accuracy
6
CLINC150 50% known ratio (test)
88.61Accuracy
6
CLINC150 25% known ratio (test)
89.79Accuracy
6
CLINC150 75% seen classes (test)
88.08Accuracy
6
CLINC150 50% seen classes (test)
88.33Accuracy
6
CLINC150 25% seen classes (test)
88.44Accuracy
6
CLINC150 (test)
2.34KL Divergence
4
Clinc150
0.236ECE
4
CLINC150 OOD (test)
88.24ACCOOD
3
CLINC150 (deployment)
453Count of Failures Fixed
2