Query-to-Item Retrieval on Industrial-scale e-commerce dataset
12.74Recall@10Multi-view Bertsy (multimodal)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Multi-view Bertsy (multimodal)Modality=multimodal, Evaluation Protocol=zero-shot2025.12 | 12.74 | 19.09 | 20.97 | |
| Single-view Bertsy (multimodal)Modality=multimodal, Evaluation Protocol=zero-shot2025.12 | 10.43 | 15.99 | 17.78 | |
| Single-view Bertsy (text-only)Modality=text-only, Evaluation Protocol=zero-shot2025.12 | 8.42 | 12.68 | 14.01 | |
| Marqo (multimodal)Modality=multimodal, Evaluation Protocol=zero-shot2025.12 | 8.36 | 12.12 | 13.06 | |
| Marqo (text-only)Modality=text-only, Evaluation Protocol=zero-shot2025.12 | 5.37 | 7.28 | 6.95 | |
| OpenAI text-embedding-3Modality=text-only, Evaluation Protocol=zero-shot2025.12 | 5.32 | 10.13 | 12.51 | |
| Gemini-embeddingModality=text-only, Evaluation Protocol=zero-shot2025.12 | 4.98 | 11.88 | 13.67 | |
| Qwen-8BModality=text-only, Evaluation Protocol=zero-shot2025.12 | 4.42 | 9.56 | 11.59 | |
| JINAv3Modality=text-only, Evaluation Protocol=zero-shot2025.12 | 1.77 | 4.72 | 3.86 |