Out-of-Distribution Detection on CLINC OOD (train)
6.11EERL-Mahalanobis
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| L-MahalanobisModel=ROBERTa, Last Layer=DRM2021.06 | 6.11 | 7.63 | 5.98 | 98.16 | 99.56 | 92.96 | |
| MahalanobisModel=ROBERTa, Last Layer=DRM2021.06 | 6.31 | 7.8 | 6.13 | 98.07 | 99.53 | 92.86 | |
| L-MahalanobisModel=BERT, Last Layer=DRM2021.06 | 6.7 | 10.12 | 6.62 | 97.77 | 99.46 | 91.55 | |
| L-MahalanobisModel=ROBERTa, Last Layer=Linear2021.06 | 6.9 | 9.53 | 6.71 | 97.94 | 99.5 | 92.47 | |
| MahalanobisModel=BERT, Last Layer=DRM2021.06 | 7.01 | 10.88 | 6.88 | 97.43 | 99.37 | 90.36 | |
| L-MahalanobisModel=BERT, Last Layer=Linear2021.06 | 7.21 | 10.18 | 6.92 | 97.52 | 99.41 | 89.37 | |
| EntropyModel=ROBERTa, Last Layer=DRM2021.06 | 8.29 | 11.51 | 7.86 | 97.17 | 99.27 | 90.69 | |
| MahalanobisModel=BERT, Last Layer=Linear2021.06 | 8.31 | 12.68 | 8.02 | 96.9 | 99.14 | 88.19 | |
| EntropyModel=BERT, Last Layer=DRM2021.06 | 8.31 | 12.53 | 8.14 | 96.67 | 99.01 | 89.68 | |
| ConfidenceModel=ROBERTa, Last Layer=DRM2021.06 | 8.35 | 11.76 | 8.02 | 97.1 | 99.25 | 90.46 | |
| MahalanobisModel=ROBERTa, Last Layer=Linear2021.06 | 8.4 | 11.82 | 8.13 | 96.92 | 99.06 | 90.37 | |
| ConfidenceModel=BERT, Last Layer=DRM2021.06 | 8.5 | 12.85 | 7.85 | 96.34 | 98.95 | 87.51 | |
| En-AEModel=ROBERTa, Last Layer=N/A2021.06 | 8.56 | 12.38 | 8.29 | 96.82 | 99.08 | 90.06 | |
| En-AEModel=BERT, Last Layer=N/A2021.06 | 8.7 | 13.03 | 8.47 | 96.12 | 98.89 | 88.38 | |
| G-ODINModel=ROBERTa, Last Layer=N/A2021.06 | 8.85 | 12.26 | 8.53 | 96.74 | 99.12 | 89.95 | |
| G-ODINModel=BERT, Last Layer=N/A2021.06 | 8.91 | 12.99 | 8.4 | 95.81 | 98.75 | 88.81 | |
| ODINModel=BERT, Last Layer=N/A2021.06 | 9.01 | 16.52 | 8.66 | 96.24 | 98.73 | 87.34 | |
| ODINModel=ROBERTa, Last Layer=N/A2021.06 | 9.11 | 15.12 | 8.68 | 96.11 | 98.84 | 88.72 | |
| EntropyModel=ROBERTa, Last Layer=Linear2021.06 | 9.31 | 14.81 | 8.93 | 95.89 | 98.73 | 88.7 | |
| EntropyModel=BERT, Last Layer=Linear2021.06 | 10.33 | 17.99 | 10.1 | 95.65 | 98.73 | 87.2 | |
| ConfidenceModel=ROBERTa, Last Layer=Linear2021.06 | 10.81 | 22.35 | 10.38 | 95.23 | 98.58 | 86.46 | |
| ConfidenceModel=BERT, Last Layer=Linear2021.06 | 11.31 | 21.98 | 11 | 94.96 | 98.52 | 84.59 | |
| ERAEPOGModel=N/A, Last Layer=N/A2021.06 | 12.04 | 23.7 | 11.67 | 95.83 | 99.05 | 83.98 | |
| AEModel=N/A, Last Layer=N/A2021.06 | 18.13 | 58.5 | 23.94 | 87.78 | 96.98 | 54.12 | |
| En-ConGANModel=BERT, Last Layer=N/A2021.06 | 75.2 | 98.72 | 49.95 | 22.36 | 69.86 | 11.27 | |
| ConGANModel=N/A, Last Layer=N/A2021.06 | 78.9 | 94.4 | 52.04 | 52.22 | 82.79 | 23.54 | |
| En-ConGANModel=ROBERTa, Last Layer=N/A2021.06 | 80.26 | 99.34 | 49.95 | 15.2 | 66.64 | 10.58 |