Multilingual Information Retrieval on MTEB-DE (test)
56.2nDCG@10DRAMA1B
Evaluation Results
| Method | Links | |
|---|---|---|
| DRAMA1BNon-Emb. Param.=1B, Repre. Dim.=2048, Contra. Pretrain.=false, Data Aug.=true, Multi. Lang.=true2025.02 | 56.2 | |
| ArcticEmb-v2-LNon-Emb. Param.=303M, Repre. Dim.=1024, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.02 | 55.9 | |
| DRAMA1B (768d)Non-Emb. Param.=1B, Repre. Dim.=768, Contra. Pretrain.=false, Data Aug.=true, Multi. Lang.=true2025.02 | 55.8 | |
| DRAMA0.3BNon-Emb. Param.=265M, Repre. Dim.=1024, Contra. Pretrain.=false, Data Aug.=true, Multi. Lang.=true2025.02 | 55.6 | |
| DRAMA0.1BNon-Emb. Param.=113M, Repre. Dim.=768, Contra. Pretrain.=false, Data Aug.=true, Multi. Lang.=true2025.02 | 55.1 | |
| ArcticEmb-v2-MNon-Emb. Param.=113M, Repre. Dim.=768, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.02 | 55 | |
| mE5-InstNon-Emb. Param.=303M, Repre. Dim.=1024, Contra. Pretrain.=true, Data Aug.=true, Multi. Lang.=true2025.02 | 52.5 | |
| mE5-largeNon-Emb. Param.=303M, Repre. Dim.=1024, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.02 | 50.4 | |
| M3-BGE-DenseNon-Emb. Param.=303M, Repre. Dim.=1024, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.02 | 50.4 | |
| mE5-baseNon-Emb. Param.=86M, Repre. Dim.=768, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.02 | 49.2 | |
| mGTE-DenseNon-Emb. Param.=113M, Repre. Dim.=768, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.02 | 49.1 |