Unknown Intent Detection on StackOverflow 50% seen classes (test)
86.4AccuracyADB
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ADBBackbone=BERT2020.12 | 86.4 | 85.83 | |
| DCLOOSEncoder=BERT-base-uncased2021.06 | 75.08 | 78.55 | |
| SEGEncoder=BERT-base-uncased2021.06 | 68.5 | 74.18 | |
| SoftmaxEncoder=BERT-base-uncased2021.06 | 65.96 | 71.94 | |
| LMCLEncoder=BERT-base-uncased2021.06 | 64.34 | 71.8 | |
| DOCEncoder=BERT-base-uncased2021.06 | 61.62 | 68.97 | |
| OpenMaxBackbone=BERT2020.12 | 60.35 | 68.18 | |
| DeepUnkBackbone=BERT2020.12 | 58.98 | 68.01 | |
| MSPEncoder=BERT-base-uncased2021.06 | 56.33 | 62.92 | |
| DOCBackbone=BERT2020.12 | 52.53 | 62.84 | |
| MSPBackbone=BERT2020.12 | 52.42 | 63.01 |