Snips
Benchmarks
TaskDatasetSOTA resultTrendResults
SNIPS (test)
99.7Accuracy
40
Snips (test)
99.29Intent Acc
27
SNIPS (test)
0.983F1 Score
25
SNIPS
95.61NMI
19
SNIPS Type 3 (test)
96.2Accuracy
15
SNIPS Type 2 (test)
98.9Accuracy
15
SNIPS Type 1 (test)
98.6Accuracy
15
SNIPS
97Slot F1
15
SNIPS (test)
84.1Macro F1
15
SNIPS all target domains
0.578F1 Score
12
SNIPS SearchCreativeWork zero-shot (test)
72.88F1-score
11
SNIPS RateBook zero-shot (test)
47.53F1 Score
11
SNIPS PlayMusic zero-shot (test)
66.42F1 Score
11
SNIPS zero-shot Average
61.07F1 Score
11
SNIPS zero-shot (SearchScreeningEvent)
51.42F1 Score
11
SNIPS GetWeather zero-shot
65.36F1 Score
11
SNIPS BookRestaurant zero-shot
63.77F1 Score
11
SNIPS zero-shot AddToPlaylist
68.7F1 Score
11
SNIPS (test)
89.3NMI
11
SNIPS standard (test)
92.32Macro F1
10
SNIPS (unsupervised)
97Accuracy
9
SNIPS
98.7F1 Score
8
SNIPS 5-shot
89.39We Score
8
SNIPS
10CT
7
SNIPS
96.1Accuracy
6