Snips
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SNIPS 1-shot
70.44Average Score
6
SNIPS
98.57Accuracy
5
SNIPS
92.8F1-Macro
5
SNIPS (full)
92.1F1-Macro
5
SNIPS
97.98AUROC
4
SNIPS
99.43Intent Accuracy
4
SNIPS Far Field
74.64EM Accuracy (Hyp)
4
SNIPS Close Field
84.88EM Accuracy (Hyp)
4
SNIPS 7 classes
99.1Accuracy
3
Manual SNIPS-style (Manual pair shift)
0.867Exact Match (EM)
3
Manual SNIPS-style (Manual unseen pairs)
97.5EM
3
Snips Re Cr 2018
75.92Precision
3
SNIPS (test)
8.983Throughput (sentences/sec)
3
SNIPS OOD
74.95Accuracy
2
SNIPS SearchCreativeWork zero-shot
—F1-score (zero-shot)
0
SNIPS PlayMusic zero-shot
—F1 Score
0