Dependency Parsing on DialectBench v1 (test)
58.55UAS (aln)VAÇAÍ-Bowl
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| VAÇAÍ-BowlBackbone=XLM-R, Source Selection Strategy=LangRank2026.05 | 58.55 | 31.23 | 12.51 | 42.41 | 36.13 | 59.82 | 48.38 | 42.53 | 47.47 | 34.56 | |
| VAÇAÍ-BowlBackbone=XLM-R, Source Selection Strategy=TOPPing2026.05 | 57.5 | 31.97 | 13.98 | 44.66 | 37.76 | 63.44 | 51.65 | 40.99 | 57.74 | 36.6 | |
| AlignmentBackbone=XLM-R, Source Selection Strategy=LangRank2026.05 | 57.41 | 28.44 | 12.47 | 40.49 | 35.8 | 59.51 | 47.61 | 42.16 | 46.95 | 34.3 | |
| AlignmentBackbone=XLM-R, Source Selection Strategy=TOPPing2026.05 | 56.54 | 28.67 | 8.47 | 39.6 | 35.85 | 63.13 | 50.81 | 40.2 | 56.62 | 34.76 | |
| XLM-RBackbone=XLM-R, Source Selection Strategy=LangRank2026.05 | 55.58 | 28.44 | 10.95 | 41.51 | 33.27 | 60.37 | 47.36 | 41.25 | 43.75 | 33.08 | |
| XLM-RBackbone=XLM-R, Source Selection Strategy=TOPPing2026.05 | 55.07 | 30.57 | 11.27 | 40.5 | 38.04 | 63.8 | 48.73 | 40.76 | 52.23 | 35.68 | |
| XLM-RBackbone=XLM-R, Source Selection Strategy=English source2026.05 | 52.58 | 13.61 | 4.38 | 31.5 | 30.6 | 53.79 | 42.92 | 30.2 | 43.6 | 24.5 | |
| VAÇAÍ-BowlBackbone=mBERT, Source Selection=LangRank2026.05 | 51 | 27.05 | 17.21 | 36.9 | 35.32 | 63.02 | 50.92 | 32.62 | 52.23 | 36.29 | |
| AlignmentBackbone=mBERT, Source Selection=LangRank2026.05 | 49.58 | 25.98 | 16.4 | 36.33 | 33.37 | 59.68 | 50.49 | 29.9 | 52.6 | 34.67 | |
| VAÇAÍ-BowlBackbone=mBERT, Source Selection=TOPPing2026.05 | 46.34 | 36.39 | 19 | 42.29 | 38.19 | 64.29 | 54.9 | 39.67 | 57.74 | 37.67 | |
| AlignmentBackbone=mBERT, Source Selection=TOPPing2026.05 | 45.3 | 31.56 | 16.53 | 40.72 | 36.52 | 62.96 | 52.04 | 38.8 | 54.84 | 35.99 | |
| mBERTBackbone=mBERT, Source Selection=TOPPing2026.05 | 44.55 | 34.1 | 15.18 | 40.83 | 36.8 | 63.99 | 52.54 | 35.63 | 57.22 | 37.21 | |
| mBERTBackbone=mBERT, Source Selection=LangRank2026.05 | 43.9 | 22.13 | 10.47 | 33.97 | 32.51 | 59.38 | 46.45 | 27.79 | 51.12 | 36.14 | |
| XLM-RBackbone=XLM-R, Source Selection Strategy=English source (reported in original paper), Reporting Source=Faisal et al. (2024)2026.05 | 43.5 | 11.15 | 4.23 | 30.91 | 32.14 | 43.78 | 34.7 | 28.28 | 34.7 | 28.75 | |
| mBERTBackbone=mBERT, Source Selection=English2026.05 | 39.13 | 13.03 | 12.91 | 30.03 | 29.79 | 49.86 | 42.61 | 20.81 | 42.49 | 32.01 | |
| mBERT (reported)Backbone=mBERT, Source Selection=English, Note=Value reported in original paper2026.05 | 38.14 | 13.51 | 8.95 | 26.12 | 26.89 | 50.22 | 36.77 | 19.41 | 36.77 | 33.21 |