List your company
ResearchFormerly WizWand

Multilingual Information Retrieval on MTEB-FR (test)

57.6nDCG@10DRAMA1B
44.91248.20651.554.794Feb 25, 2025
Updated 8mo ago

Evaluation results

MethodLinks
DRAMA1BNon-Emb. Param.=1B, Repre. Dim.=2048, Contra. Pretrain.=false, Data Aug.=true, Multi. Lang.=true2025.0257.6
DRAMA1B (768d)Non-Emb. Param.=1B, Repre. Dim.=768, Contra. Pretrain.=false, Data Aug.=true, Multi. Lang.=true2025.0256.5
DRAMA0.3BNon-Emb. Param.=265M, Repre. Dim.=1024, Contra. Pretrain.=false, Data Aug.=true, Multi. Lang.=true2025.0254.8
ArcticEmb-v2-LNon-Emb. Param.=303M, Repre. Dim.=1024, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.0254.5
ArcticEmb-v2-MNon-Emb. Param.=113M, Repre. Dim.=768, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.0253.7
DRAMA0.1BNon-Emb. Param.=113M, Repre. Dim.=768, Contra. Pretrain.=false, Data Aug.=true, Multi. Lang.=true2025.0252.1
mGTE-DenseNon-Emb. Param.=113M, Repre. Dim.=768, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.0250.6
mE5-InstNon-Emb. Param.=303M, Repre. Dim.=1024, Contra. Pretrain.=true, Data Aug.=true, Multi. Lang.=true2025.0249.9
M3-BGE-DenseNon-Emb. Param.=303M, Repre. Dim.=1024, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.0248.6
mE5-largeNon-Emb. Param.=303M, Repre. Dim.=1024, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.0247.7
mE5-baseNon-Emb. Param.=86M, Repre. Dim.=768, Contra. Pretrain.=true, Data Aug.=false, Multi. Lang.=true2025.0245.4