Information Retrieval on Bing-Click (test)
68.94Recall@100m3BERT-s3
Evaluation results
| Method | Links | ||
|---|---|---|---|
| m3BERT-s3Layer Configuration=Full, Embedding Dimension=1282026.05 | 68.94 | 89.23 | |
| m3BERT-s2Layer Configuration=Full, Embedding Dimension=7682026.05 | 68.32 | 89 | |
| mE5Layer Configuration=Full, Embedding Dimension=7682026.05 | 67.97 | 88.49 | |
| m3BERT-s3Layer Configuration=Lite (1/3 layers), Embedding Dimension=1282026.05 | 67.72 | 88.51 | |
| m3BERT-s3Layer Configuration=Full, Embedding Dimension=642026.05 | 67.6 | 88.35 | |
| ModernBERTLayer Configuration=Full, Embedding Dimension=7682026.05 | 67.5 | 88.25 | |
| m3BERT-s2Layer Configuration=Full, Embedding Dimension=1282026.05 | 67.34 | 88.37 | |
| mBERTLayer Configuration=Full, Embedding Dimension=7682026.05 | 67.33 | 88.12 | |
| mE5Layer Configuration=Full, Embedding Dimension=1282026.05 | 66.85 | 87.39 | |
| mBERTLayer Configuration=Full, Embedding Dimension=1282026.05 | 66.76 | 87.69 | |
| ModernBERTLayer Configuration=Full, Embedding Dimension=1282026.05 | 66.75 | 87.71 | |
| m3BERT-s3Layer Configuration=Lite (1/3 layers), Embedding Dimension=642026.05 | 66.47 | 87.67 | |
| m3BERT-s2Layer Configuration=Lite (1/3 layers), Embedding Dimension=7682026.05 | 66.33 | 87.66 | |
| m3BERT-s2Layer Configuration=Lite (1/3 layers), Embedding Dimension=1282026.05 | 65.47 | 87.02 | |
| m3BERT-s2Layer Configuration=Full, Embedding Dimension=642026.05 | 65.44 | 87 | |
| mBERTLayer Configuration=Lite (1/3 layers), Embedding Dimension=7682026.05 | 65.39 | 86.99 | |
| mE5Layer Configuration=Lite (1/3 layers), Embedding Dimension=7682026.05 | 65.39 | 86.9 | |
| ModernBERTLayer Configuration=Lite (1/3 layers), Embedding Dimension=7682026.05 | 65.34 | 86.87 | |
| mBERTLayer Configuration=Full, Embedding Dimension=642026.05 | 64.63 | 86.28 | |
| ModernBERTLayer Configuration=Full, Embedding Dimension=642026.05 | 64.62 | 86.27 | |
| ModernBERTLayer Configuration=Lite (1/3 layers), Embedding Dimension=1282026.05 | 64.59 | 86.23 | |
| mBERTLayer Configuration=Lite (1/3 layers), Embedding Dimension=1282026.05 | 64.58 | 86.27 | |
| mE5Layer Configuration=Lite (1/3 layers), Embedding Dimension=1282026.05 | 64.4 | 86.14 | |
| mE5Layer Configuration=Full, Embedding Dimension=642026.05 | 64.32 | 85.98 | |
| m3BERT-s2Layer Configuration=Lite (1/3 layers), Embedding Dimension=642026.05 | 63.43 | 85.49 | |
| m3BERT-s3Layer Configuration=Full, Embedding Dimension=322026.05 | 63.3 | 85.5 | |
| mBERTLayer Configuration=Lite (1/3 layers), Embedding Dimension=642026.05 | 62.5 | 84.67 | |
| ModernBERTLayer Configuration=Lite (1/3 layers), Embedding Dimension=642026.05 | 62.43 | 84.59 | |
| mE5Layer Configuration=Lite (1/3 layers), Embedding Dimension=642026.05 | 62.16 | 84.4 | |
| m3BERT-s3Layer Configuration=Lite (1/3 layers), Embedding Dimension=322026.05 | 62.06 | 84.52 | |
| m3BERT-s2Layer Configuration=Full, Embedding Dimension=322026.05 | 60.25 | 83.29 | |
| mBERTLayer Configuration=Full, Embedding Dimension=322026.05 | 59.74 | 82.83 | |
| ModernBERTLayer Configuration=Full, Embedding Dimension=322026.05 | 59.44 | 82.65 | |
| mE5Layer Configuration=Full, Embedding Dimension=322026.05 | 59.31 | 82.24 | |
| m3BERT-s2Layer Configuration=Lite (1/3 layers), Embedding Dimension=322026.05 | 58.34 | 81.67 | |
| mBERTLayer Configuration=Lite (1/3 layers), Embedding Dimension=322026.05 | 57.46 | 80.78 | |
| mE5Layer Configuration=Lite (1/3 layers), Embedding Dimension=322026.05 | 57.18 | 80.63 | |
| ModernBERTLayer Configuration=Lite (1/3 layers), Embedding Dimension=322026.05 | 57.1 | 80.55 |