Morphosyntax Anomaly Detection on BLIMP Subject-Verb
97.1AccuracyGaussian anomaly model
Evaluation results
| Method | Links | |
|---|---|---|
| Gaussian anomaly modelBackbone=RoBERTa, Anomaly Model=GM, Layer Selection=Best layer2021.05 | 97.1 | |
| Masked language modelBackbone=RoBERTa, Anomaly Model=MLM, Layer Selection=Last layer2021.05 | 95.7 | |
| Masked language modelBackbone=BERT, Anomaly Model=MLM, Layer Selection=Last layer2021.05 | 95.5 | |
| Gaussian anomaly modelBackbone=BERT, Anomaly Model=GM, Layer Selection=Best layer2021.05 | 95.3 | |
| Gaussian anomaly modelBackbone=XLNet, Anomaly Model=GM, Layer Selection=Best layer2021.05 | 82.7 | |
| Masked language modelBackbone=XLNet, Anomaly Model=MLM, Layer Selection=Last layer2021.05 | 58.4 |