Vendor Verification on Valhalla-Berlusconi (test)
89.87Micro-F1BERT-cased
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BERT-casedEvaluation Protocol=End-to-End2023.05 | 89.87 | 81.48 | |
| transfer-BiGRUEvaluation Protocol=Transfer, Layer=Second-to-Last2023.05 | 89.51 | 78.84 | |
| transfer-BiGRUEvaluation Protocol=Transfer, Layer=Weighted Sum Last 42023.05 | 89.46 | 81.32 | |
| transfer-BiGRUEvaluation Protocol=Transfer, Layer=Weighted Sum All 122023.05 | 89.28 | 78.37 | |
| transfer-BiGRUEvaluation Protocol=Transfer, Layer=Last2023.05 | 85.9 | 78.09 | |
| BiGRU-FasttextEvaluation Protocol=End-to-End2023.05 | 77.97 | 69.57 | |
| ArchitecturalEvaluation Protocol=Zero-Shot2023.05 | 77.02 | 29.27 | |
| transfer-BiGRUEvaluation Protocol=Transfer, Layer=Embedding2023.05 | 76.53 | 64.08 | |
| MethodologicalEvaluation Protocol=Zero-Shot2023.05 | 73.88 | 24.01 |