Unknown Intent Detection on SNIPS (test)
84.1Macro F1LOF (LMCL)
Evaluation results
| Method | Links | |
|---|---|---|
| LOF (LMCL)% of known intents=50%2019.06 | 84.1 | |
| LOF (LMCL)% of known intents=25%2019.06 | 79.2 | |
| LOF (LMCL)% of known intents=75%2019.06 | 78.8 | |
| LOF (Softmax)% of known intents=25%2019.06 | 76 | |
| DOC (Softmax)% of known intents=25%2019.06 | 72.8 | |
| DOC% of known intents=25%2019.06 | 72.5 | |
| LOF (Softmax)% of known intents=50%2019.06 | 69.4 | |
| DOC% of known intents=50%2019.06 | 67.9 | |
| LOF (Softmax)% of known intents=75%2019.06 | 65.8 | |
| DOC (Softmax)% of known intents=50%2019.06 | 65.7 | |
| DOC% of known intents=75%2019.06 | 63.9 | |
| DOC (Softmax)% of known intents=75%2019.06 | 61.8 | |
| MSP% of known intents=75%2019.06 | 8.3 | |
| MSP% of known intents=50%2019.06 | 6.2 | |
| MSP% of known intents=25%2019.06 | 0 |