Vocabulary Difficulty Prediction on BEA Shared Task cn 2026 (dev)
0.9681RMSEBGE-M3
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| BGE-M3Modeling Strategy=Neural Fusion2026.06 | 0.9681 | 0.2069 | 0.8351 | 0.8428 | 0.6568 | |
| multilingual-E5Modeling Strategy=Neural Fusion2026.06 | 0.9726 | 0.2024 | 0.834 | 0.8387 | 0.6493 | |
| Textualised Feature2026.06 | 0.975 | 0.2 | 0.8283 | 0.8362 | 0.6459 | |
| LaBSEModeling Strategy=Neural Fusion2026.06 | 0.9937 | 0.1813 | 0.8179 | 0.822 | 0.6343 | |
| Late fusion2026.06 | 1.0929 | 0.0821 | 0.7623 | 0.7722 | 0.5775 | |
| mBERTModeling Strategy=Neural Fusion2026.06 | 1.1227 | 0.0523 | 0.7673 | 0.7737 | 0.5868 | |
| Baseline (closed)2026.06 | 1.175 | — | 0.736 | — | — | |
| XLM-R-largeModeling Strategy=Neural Fusion2026.06 | 1.2552 | -0.0802 | 0.6704 | 0.6699 | 0.4906 |