Out-of-Distribution Detection on ATIS IND Movie OOD
1.85EERDRM+L-Mahalanobis
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DRM+L-MahalanobisBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 1.85 | 0 | 1.23 | 99.78 | 99.97 | 98.22 | |
| DRM+L-MahalanobisBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 3.36 | 1.01 | 2.85 | 99.53 | 99.92 | 97.38 | |
| MahalanobisBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 3.41 | 2.35 | 3.02 | 99.43 | 99.89 | 97.27 | |
| En-AEBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 3.69 | 0.35 | 1.97 | 99.63 | 98.72 | 97.93 | |
| MahalanobisBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 6.48 | 11.64 | 5.04 | 98.72 | 99.71 | 95.45 | |
| En-AEBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 7.28 | 16.05 | 4.46 | 93.56 | 99.58 | 76.13 | |
| G-ODINBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 9.97 | 17.76 | 8.98 | 96.85 | 99.59 | 85.9 | |
| ODINBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 10.08 | 18.52 | 9.37 | 96.73 | 99.58 | 84.88 | |
| EntropyBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 10.12 | 17.59 | 9.38 | 96.68 | 99.57 | 85.02 | |
| ConfidenceBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 10.19 | 17.59 | 9.33 | 96.62 | 99.56 | 84.27 | |
| En-ConGANBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 15.12 | 14.35 | 7.56 | 57.44 | 88.23 | 17.56 | |
| ConfidenceBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 16.7 | 47.94 | 15.15 | 91.99 | 98.5 | 67.58 | |
| EntropyBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 17.26 | 44.24 | 16.12 | 92.14 | 98.5 | 70.87 | |
| G-ODINBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 18.23 | 36.42 | 17.27 | 91.97 | 98.34 | 72.07 | |
| ODINBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 18.95 | 39.91 | 18.38 | 91.4 | 98.29 | 71.62 | |
| En-ConGANBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 23.28 | 93.77 | 16.03 | 79.32 | 58.36 | 89.14 |