Long-context Retrieval on MLDR
62.86nDCG@10moBERTo (orig. tok.)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| moBERTo (orig. tok.)Maximum token length=40962026.06 | 62.86 | — | |
| moBERTo (orig. tok.)Maximum token length=81922026.06 | 61.66 | — | |
| moBERTo-8k (orig. tok.)Maximum token length=81922026.06 | 61.4 | — | |
| moBERTo-8k (orig. tok.)Maximum token length=20482026.06 | 60.25 | — | |
| moBERTo (orig. tok.)Maximum token length=20482026.06 | 59.09 | — | |
| moBERTo-SWM-8k (PT tok.)Maximum token length=40962026.06 | 59.05 | — | |
| moBERTo-8k (orig. tok.)Maximum token length=40962026.06 | 58.76 | — | |
| moBERTo-SWM (PT tok.)Maximum token length=81922026.06 | 58.57 | — | |
| moBERTo (orig. tok.)Maximum token length=5122026.06 | 58.34 | — | |
| moBERTo-SWM-8k (PT tok.)Maximum token length=5122026.06 | 58.27 | — | |
| moBERTo-SWM-8k (PT tok.)Maximum token length=81922026.06 | 57.77 | — | |
| moBERTo-SWM (PT tok.)Maximum token length=40962026.06 | 57.14 | — | |
| moBERTo-8k (orig. tok.)Maximum token length=5122026.06 | 56.74 | — | |
| moBERTo-SWM-8k (PT tok.)Maximum token length=20482026.06 | 56.06 | — | |
| moBERTo-SWM (PT tok.)Maximum token length=5122026.06 | 54.66 | — | |
| Qwen-baseMaximum token length=81922026.06 | 53.51 | — | |
| NeoBERT-baseMaximum token length=20482026.06 | 51.49 | — | |
| BERTimbau-baseMaximum token length=5122026.06 | 51.19 | — | |
| Qwen3-0.6B-PTMaximum token length=81922026.06 | 49.16 | — | |
| moBERTo-SWM (PT tok.)Maximum token length=20482026.06 | 47.91 | — | |
| NeoBERT-baseMaximum token length=5122026.06 | 47.46 | — | |
| NeoBERT-baseMaximum token length=40962026.06 | 46.76 | — | |
| NeoBERT-PTMaximum token length=5122026.06 | 43.96 | — | |
| NeoBERT-PTMaximum token length=40962026.06 | 43.28 | — | |
| Qwen-baseMaximum token length=40962026.06 | 42.41 | — | |
| ModernBERT-baseMaximum token length=20482026.06 | 42.06 | — | |
| ModernBERT-baseMaximum token length=5122026.06 | 40.54 | — | |
| NeoBERT-PTMaximum token length=20482026.06 | 40.3 | — | |
| BERT-baseMaximum token length=5122026.06 | 40.29 | — | |
| Qwen-baseMaximum token length=20482026.06 | 40.23 | — | |
| Qwen3-0.6B-PTMaximum token length=5122026.06 | 38.73 | — | |
| Qwen-baseMaximum token length=5122026.06 | 35.6 | — | |
| Qwen3-0.6B-PTMaximum token length=40962026.06 | 34.2 | — | |
| Qwen3-0.6B-PTMaximum token length=20482026.06 | 34.13 | — | |
| ModernBERT-baseMaximum token length=40962026.06 | 30.15 | — | |
| ModernBERT-baseMaximum token length=81922026.06 | 28.67 | — | |
| BERT baseModel Size Category=Base, Parameters=123-150M2025.07 | — | 24.8 | |
| BERT largeModel Size Category=Large, Parameters=353-395M2025.07 | — | 25.3 | |
| BERT-miniModel Size Category=XXS, Parameters=7-17M2025.07 | — | 16.8 | |
| BERT-smallModel Size Category=XS, Parameters=28-33M2025.07 | — | 19.9 | |
| DeBERTa-v1-xlModel Size Category=XL, Parameters=884M-1.2B2025.07 | — | 28.1 | |
| DistilBERTModel Size Category=Small, Parameters=68-82M2025.07 | — | 23.7 | |
| DistilRoBERTaModel Size Category=Small, Parameters=68-82M2025.07 | — | 19.7 | |
| Ettin-Enc-150mModel Size Category=Base, Parameters=123-150M2025.07 | — | 31.8 | |
| Ettin-Enc-17mModel Size Category=XXS, Parameters=7-17M2025.07 | — | 24.4 | |
| Ettin-Enc-1BModel Size Category=XL, Parameters=884M-1.2B2025.07 | — | 40.2 | |
| Ettin-Enc-32mModel Size Category=XS, Parameters=28-33M2025.07 | — | 28.4 | |
| Ettin-Enc-400mModel Size Category=Large, Parameters=353-395M2025.07 | — | 36.2 | |
| Ettin-Enc-68mModel Size Category=Small, Parameters=68-82M2025.07 | — | 30.1 | |
| MiniLM L12Model Size Category=XS, Parameters=28-33M2025.07 | — | 19.6 | |
| ModernBERT baseModel Size Category=Base, Parameters=123-150M2025.07 | — | 30.4 | |
| ModernBERT largeModel Size Category=Large, Parameters=353-395M2025.07 | — | 34.9 | |
| TinyBERTModel Size Category=XXS, Parameters=7-17M2025.07 | — | 14.2 |