E-commerce Text Embedding Retrieval on Proprietary e-commerce dataset v4 (test)
68.39Average ScoreCompass-Embedding v4
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Compass-Embedding v4Size (B)=42025.12 | 68.39 | 71.41 | 55.01 | 76.74 | 83.24 | 33.24 | 90.71 | |
| BGE-Multilingual-Gemma2Size (B)=92025.12 | 63.56 | 61.74 | 55.96 | 73.68 | 79.24 | 21.88 | 88.85 | |
| Qwen3-Embedding-4BSize (B)=42025.12 | 62.35 | 63.77 | 50.17 | 70.56 | 76.59 | 27.94 | 85.09 | |
| Text-Embedding-3-LargeSize (B)=-2025.12 | 61.39 | 57.24 | 46.54 | 74.85 | 77.62 | 25.03 | 87.09 | |
| Compass-Embedding v3Size (B)=72025.12 | 58.87 | 62.75 | 49.12 | 71.74 | 74.28 | 19.4 | 75.93 | |
| KaLM-Multi-Mini-Inst-v2.5Size (B)=0.52025.12 | 56.15 | 54.05 | 37.89 | 70.44 | 69.41 | 23.03 | 82.1 | |
| Text-Embedding-3-SmallSize (B)=-2025.12 | 55.75 | 52.04 | 40.9 | 68.43 | 69.87 | 19.79 | 83.51 | |
| Multilingual-E5-Large-InstructSize (B)=0.562025.12 | 54.98 | 50.52 | 38.72 | 73.82 | 73.73 | 10.7 | 82.41 | |
| F2LLM-4BSize (B)=42025.12 | 52.83 | 54.15 | 43.18 | 62.53 | 67.5 | 15.73 | 73.9 |