Vendor Verification on Traderoute-Agora (test)
87.5Micro-F1BERT-cased
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| BERT-casedBaseline Type=End-to-End2023.05 | 87.5 | 87 | |
| transfer-BiGRUBaseline Type=Transfer, Layer=Weighted Sum Last 42023.05 | 80.65 | 81.77 | |
| ArchitecturalBaseline Type=Zero-Shot2023.05 | 73.05 | 21.73 | |
| transfer-BiGRUBaseline Type=Transfer, Layer=Last2023.05 | 70.61 | 71.53 | |
| transfer-BiGRUBaseline Type=Transfer, Layer=Second-to-Last2023.05 | 69.92 | 69.11 | |
| transfer-BiGRUBaseline Type=Transfer, Layer=Embedding2023.05 | 67.07 | 66.98 | |
| transfer-BiGRUBaseline Type=Transfer, Layer=Weighted Sum All 122023.05 | 66.98 | 67.03 | |
| BiGRU-FasttextBaseline Type=End-to-End2023.05 | 65.77 | 65.39 | |
| MethodologicalBaseline Type=Zero-Shot2023.05 | 64.98 | 15.63 |