Semantic Anomaly Detection on BLIMP Animacy
78.7AccuracyMasked language model
Evaluation results
| Method | Links | |
|---|---|---|
| Masked language modelBackbone=BERT, Anomaly Model=MLM, Layer Selection=Last layer2021.05 | 78.7 | |
| Gaussian anomaly modelBackbone=RoBERTa, Anomaly Model=GM, Layer Selection=Best layer2021.05 | 76.7 | |
| Masked language modelBackbone=RoBERTa, Anomaly Model=MLM, Layer Selection=Last layer2021.05 | 75.4 | |
| Gaussian anomaly modelBackbone=XLNet, Anomaly Model=GM, Layer Selection=Best layer2021.05 | 67.5 | |
| Masked language modelBackbone=XLNet, Anomaly Model=MLM, Layer Selection=Last layer2021.05 | 65.7 | |
| Gaussian anomaly modelBackbone=BERT, Anomaly Model=GM, Layer Selection=Best layer2021.05 | 64.4 |