Dependency Parsing on Universal Dependencies 2.7 (test)
70.8AR DP ScoreLTSFT
Evaluation results
| Method | Links | |||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LTSFT2023.06 | 70.8 | 43.1 | 49.2 | 68.2 | 60 | 73.7 | 36.9 | 50.5 | 74.6 | 65.9 | 66.4 | 49.5 | 58 | 36.4 | 51.1 | 59.8 | 57.1 | — | — | |
| BISTIL-TFLRF=2, Evaluation Protocol=Teacher-Forcing2023.06 | 70.3 | 43.4 | 46.8 | 67.1 | 57.7 | 72.4 | 34.5 | 47.6 | 72.7 | 64.2 | 62.6 | 50.5 | 57.4 | 32.3 | 49.8 | 58.6 | 55.5 | -1.6 | — | |
| BISTIL-STLRF=2, Evaluation Protocol=Self-Training2023.06 | 68 | 41.6 | 45.7 | 66.3 | 56.6 | 70.9 | 34.1 | 48.2 | 71 | 64.5 | 64.3 | 48.9 | 57.6 | 34.5 | 49.4 | 56.7 | 54.9 | -2.2 | — | |
| BISTIL-TFLRF=3, Evaluation Protocol=Teacher-Forcing2023.06 | 67 | 43.9 | 47.6 | 65.1 | 54.2 | 70 | 33.4 | 44.2 | 69.7 | 62.3 | 61.8 | 49.2 | 55.1 | 33.3 | 48.9 | 56.5 | 53.9 | -3.3 | — | |
| DISTILMBERT2023.06 | 65.7 | 34.4 | 42.3 | 63 | 52.8 | 67.6 | 32.1 | 42.2 | 65.4 | 58.6 | 59.6 | 44.1 | 51.2 | 29.2 | 47 | 56.1 | 50.7 | -6.4 | — | |
| BISTIL-STLRF=3, Evaluation Protocol=Self-Training2023.06 | 65.5 | 42.5 | 45.9 | 64.1 | 52.7 | 68.1 | 33.2 | 46.5 | 68 | 62 | 61.5 | 46.9 | 55.1 | 32.4 | 48.6 | 55.3 | 53 | -4.1 | — | |
| LTSFTDescription=Upper-bound model2023.06 | 53.6 | 16.5 | 25.9 | 55.5 | 42.4 | 60.5 | 19.7 | 27.2 | — | 55.4 | 45.3 | 47.8 | 25.2 | 42.1 | 16.7 | 34 | 37.8 | — | — | |
| BISTIL-TFLRF=2, Strategy=TF2023.06 | 53.2 | 16.4 | 24.6 | 54.8 | 39.1 | 59 | 19 | 23.8 | — | 54.1 | 43.5 | 46 | 26.9 | 40.7 | 13.1 | 32.7 | 36.5 | -1.3 | — | |
| BISTIL-STLRF=2, Strategy=ST2023.06 | 50.9 | 15.8 | 24.1 | 53.7 | 38.3 | 57.1 | 18.7 | 23.9 | — | 52.2 | 43.7 | 46.5 | 25.2 | 39.8 | 13.3 | 31.8 | 35.6 | -2.2 | — | |
| BISTIL-TFLRF=3, Strategy=TF2023.06 | 49.7 | 16.4 | 24.4 | 52.7 | 36.8 | 57.1 | 18.2 | 21 | — | 52.2 | 41 | 43.3 | 25.1 | 38.1 | 14.5 | 31.3 | 34.8 | -3 | — | |
| BISTIL-STLRF=3, Strategy=ST2023.06 | 48.2 | 16.1 | 23.4 | 52.1 | 35 | 55.1 | 18.1 | 22.2 | — | 49.9 | 40.3 | 41.3 | 22.2 | 37.6 | 13.3 | 30.7 | 33.7 | -4.1 | — | |
| DISTILMBERT2023.06 | 47.7 | 9.9 | 19.5 | 49.1 | 31.7 | 53.2 | 16.2 | 20 | — | 43 | 34.9 | 37.6 | 17.7 | 31.4 | 11.4 | 28.9 | 30.4 | -7.4 | — | |
| SCRATCHLRF=22023.06 | 38.5 | 26.6 | 24.8 | 44.9 | 35.4 | 33.5 | 18.6 | 23.4 | 42.9 | 31.5 | 30.2 | 23 | 26.1 | 12.3 | 30.8 | 35.6 | 29.9 | -27.2 | — | |
| SCRATCHLRF=22023.06 | 16.9 | 4.9 | 6.7 | 27.8 | 9.1 | 15.2 | 6.7 | 5.6 | — | 16.1 | 12.7 | 11.1 | 3.5 | 9.3 | 3.9 | 11.5 | 11 | -26.8 | — |