Vocabulary Difficulty Prediction on BEA Shared Task es 2026 (dev)
1.0952RMSEBGE-M3
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| BGE-M3Modeling Strategy=Neural Fusion2026.06 | 1.0952 | 0.2618 | 0.8324 | 0.8373 | 0.6473 | |
| multilingual-E5Modeling Strategy=Neural Fusion2026.06 | 1.1134 | 0.2436 | 0.8301 | 0.8335 | 0.6386 | |
| XLM-R-largeModeling Strategy=Neural Fusion2026.06 | 1.1189 | 0.2381 | 0.8291 | 0.834 | 0.6416 | |
| Textualised Feature2026.06 | 1.1261 | 0.2309 | 0.8214 | 0.8239 | 0.6324 | |
| LaBSEModeling Strategy=Neural Fusion2026.06 | 1.1732 | 0.1838 | 0.8116 | 0.8136 | 0.6189 | |
| Late fusion2026.06 | 1.2667 | 0.0903 | 0.7513 | 0.7583 | 0.562 | |
| mBERTModeling Strategy=Neural Fusion2026.06 | 1.3269 | 0.0301 | 0.7415 | 0.7459 | 0.5475 | |
| Baseline (closed)2026.06 | 1.357 | — | 0.748 | — | — |