Multilingual Information Retrieval on MTEB-FR (test)
57.6nDCG@10DRAMA1B
Evaluation Results
| Method | Links | |
|---|---|---|
| DRAMA1BNon-Emb. Param.=1B, Repre. Dim.=2048, Contra. Pretrain.=false, Data Aug.=true, Multi. Lang.=true2025.02 | 57.6 | |
| DRAMA1B (768d)Non-Emb. Param.=1B, Repre. Dim.=768, Contra. Pretrain.=false, Data Aug.=true, Multi. Lang.=true2025.02 | 56.5 | |
| DRAMA0.3BNon-Emb. Param.=265M, Repre. Dim.=1024, Contra. Pretrain.=false, Data Aug.=true, Multi. Lang.=true2025.02 | 54.8 | |
| ArcticEmb-v2-LNon-Emb. Param.=303M, Repre. Dim.=1024, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.02 | 54.5 | |
| ArcticEmb-v2-MNon-Emb. Param.=113M, Repre. Dim.=768, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.02 | 53.7 | |
| DRAMA0.1BNon-Emb. Param.=113M, Repre. Dim.=768, Contra. Pretrain.=false, Data Aug.=true, Multi. Lang.=true2025.02 | 52.1 | |
| mGTE-DenseNon-Emb. Param.=113M, Repre. Dim.=768, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.02 | 50.6 | |
| mE5-InstNon-Emb. Param.=303M, Repre. Dim.=1024, Contra. Pretrain.=true, Data Aug.=true, Multi. Lang.=true2025.02 | 49.9 | |
| M3-BGE-DenseNon-Emb. Param.=303M, Repre. Dim.=1024, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.02 | 48.6 | |
| mE5-largeNon-Emb. Param.=303M, Repre. Dim.=1024, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.02 | 47.7 | |
| mE5-baseNon-Emb. Param.=86M, Repre. Dim.=768, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.02 | 45.4 |