Out-of-Distribution Detection on CLINC Movie IND OOD
3.7EERDRM+L-Mahalanobis
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DRM+L-MahalanobisBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 3.7 | 2.56 | 3.61 | 99.48 | 99.89 | 97.9 | |
| MahalanobisBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 3.9 | 6.02 | 3.72 | 99.37 | 99.81 | 97.82 | |
| DRM+L-MahalanobisBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 4.66 | 4.34 | 4.58 | 99.06 | 99.88 | 93.85 | |
| MahalanobisBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 6.11 | 15.4 | 6.02 | 98.63 | 99.82 | 91.44 | |
| En-AEBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 13.7 | 43.42 | 11 | 94.57 | 98.91 | 77.12 | |
| En-AEBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 16.05 | 32.29 | 11.87 | 92.23 | 99.01 | 68.75 | |
| G-ODINBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 18.61 | 34.19 | 18.15 | 91.86 | 98.21 | 78.98 | |
| ConfidenceBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 18.81 | 47.52 | 18.53 | 90.53 | 98.68 | 59.63 | |
| EntropyBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 19.12 | 34.64 | 18.25 | 91.79 | 98.11 | 78.66 | |
| EntropyBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 19.13 | 44.8 | 18.87 | 90.72 | 98.69 | 63.96 | |
| ConfidenceBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 19.22 | 36.81 | 18.51 | 91.65 | 98.11 | 76.78 | |
| G-ODINBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 19.25 | 37.03 | 18.91 | 90.63 | 98.7 | 66.79 | |
| ODINBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 19.42 | 34.43 | 18.24 | 91.34 | 97.96 | 78.56 | |
| ODINBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 19.94 | 39.38 | 19.33 | 90.03 | 98.53 | 65.18 | |
| En-ConGANBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 41.09 | 39.59 | 20.55 | 45.78 | 90.4 | 10.09 | |
| En-ConGANBackbone=RoBERTa, Evaluation Protocol=Model Finetuning2021.06 | 45.9 | 44.05 | 22.95 | 43.85 | 85.21 | 14.68 |