Out-of-Distribution Detection on ATIS CLINC IND OOD
2.7EERDRM+L-Mahalanobis
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DRM+L-MahalanobisBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 2.7 | 1.3 | 2.55 | 99.48 | 99.51 | 99.47 | |
| En-AEBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 4 | 2.2 | 3.45 | 99.41 | 99.43 | 99.43 | |
| MahalanobisBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 4 | 12.13 | 3.76 | 99.18 | 98.78 | 99.46 | |
| G-ODINBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 8.75 | 20.87 | 7.31 | 97.27 | 97.46 | 97.28 | |
| ODINBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 9.11 | 21.32 | 7.5 | 97.16 | 97.39 | 97.16 | |
| EntropyBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 9.91 | 21.67 | 9.11 | 97.06 | 97.25 | 97.11 | |
| ConfidenceBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 10.21 | 20.5 | 9.28 | 96.99 | 97.19 | 97.04 | |
| En-ConGANBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 21.6 | 81.52 | 15.51 | 82.34 | 84.52 | 72.74 |