Unlabelled Attachment on UD Treebanks (Multi-lingual Average)
0.8994UAS (Arabic)SynTr+RNGTr
Evaluation Results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SynTr+RNGTrSetting=Mono, Initial Parser=SynTr, Refinement=+RNGTr, Pre-training=BERT2020.03 | 0.8994 | 0.909 | 0.9247 | 0.9308 | 0.9355 | 0.9336 | 0.9656 | 0.961 | 0.9654 | 0.9149 | 0.9547 | 0.9414 | 0.785 | 0.9246 | |
| SynTrSetting=Mono, Initial Parser=SynTr2020.03 | 0.8989 | 0.9046 | 0.9138 | 0.9292 | 0.9352 | 0.9336 | 0.9633 | 0.9603 | 0.9643 | 0.9135 | 0.9553 | 0.9379 | 0.7798 | 0.9223 | |
| UDify+RNGTrSetting=Multi+Mono, Initial Parser=UDify, Refinement=+RNGTr, Pre-training=BERT2020.03 | 0.8973 | 0.9049 | 0.9104 | 0.9281 | 0.9349 | 0.9303 | 0.9644 | 0.9572 | 0.9625 | 0.9132 | 0.9554 | 0.9372 | 0.7774 | 0.921 | |
| Empty+RNGTrSetting=Mono, Initial Parser=Empty, Refinement=+RNGTr, Pre-training=BERT2020.03 | 0.8968 | 0.9069 | 0.9181 | 0.9277 | 0.9336 | 0.928 | 0.9637 | 0.9598 | 0.9637 | 0.9128 | 0.9538 | 0.9414 | 0.7749 | 0.9216 | |
| UDifySetting=Multi, Initial Parser=UDify2020.03 | 0.8772 | 0.8494 | 0.8793 | 0.9096 | 0.8642 | 0.9163 | 0.9513 | 0.9554 | 0.9437 | 0.8274 | 0.9483 | 0.9191 | 0.7456 | 0.8913 | |
| UDPipeSetting=Multi, Initial Parser=UDPipe2020.03 | 0.8754 | 0.8611 | 0.8461 | 0.8963 | 0.8988 | 0.897 | 0.9485 | 0.9349 | 0.9506 | 0.877 | 0.938 | 0.8963 | 0.7419 | 0.8894 |