List your company
ResearchFormerly WizWand

Multilingual Information Retrieval on MTEB-DE (test)

56.2nDCG@10DRAMA1B
48.81650.73352.6554.567Feb 25, 2025
Updated 8mo ago

Evaluation results

MethodLinks
DRAMA1BNon-Emb. Param.=1B, Repre. Dim.=2048, Contra. Pretrain.=false, Data Aug.=true, Multi. Lang.=true2025.0256.2
ArcticEmb-v2-LNon-Emb. Param.=303M, Repre. Dim.=1024, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.0255.9
DRAMA1B (768d)Non-Emb. Param.=1B, Repre. Dim.=768, Contra. Pretrain.=false, Data Aug.=true, Multi. Lang.=true2025.0255.8
DRAMA0.3BNon-Emb. Param.=265M, Repre. Dim.=1024, Contra. Pretrain.=false, Data Aug.=true, Multi. Lang.=true2025.0255.6
DRAMA0.1BNon-Emb. Param.=113M, Repre. Dim.=768, Contra. Pretrain.=false, Data Aug.=true, Multi. Lang.=true2025.0255.1
ArcticEmb-v2-MNon-Emb. Param.=113M, Repre. Dim.=768, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.0255
mE5-InstNon-Emb. Param.=303M, Repre. Dim.=1024, Contra. Pretrain.=true, Data Aug.=true, Multi. Lang.=true2025.0252.5
mE5-largeNon-Emb. Param.=303M, Repre. Dim.=1024, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.0250.4
M3-BGE-DenseNon-Emb. Param.=303M, Repre. Dim.=1024, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.0250.4
mE5-baseNon-Emb. Param.=86M, Repre. Dim.=768, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.0249.2
mGTE-DenseNon-Emb. Param.=113M, Repre. Dim.=768, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.0249.1