Product Classification on MBE 3.0 1.0 (test)
86.4AccuracyMOON3.0
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MOON3.0Dim.=256, Zero-shot=true2026.04 | 86.4 | 84.43 | 86.79 | 83.98 | |
| GME-Qwen2VLDim.=1536, Zero-shot=true2026.04 | 80.17 | 78.51 | 79.05 | 76.17 | |
| MOON2.0Dim.=256, Zero-shot=true2026.04 | 67.27 | 63.26 | 72.72 | 65.46 | |
| MM-EmbedDim.=4096, Zero-shot=true2026.04 | 59.99 | 63.36 | 56.58 | 50.89 | |
| MOONDim.=256, Zero-shot=true2026.04 | 58.79 | 55.16 | 62.36 | 56.53 | |
| Qwen3-VL-2B (SFT)Dim.=256, Zero-shot=true2026.04 | 57.52 | 59.13 | 69.34 | 59.84 | |
| InternVL3.5-2B (SFT)Dim.=256, Zero-shot=true2026.04 | 55.77 | 52.54 | 61.08 | 52.77 | |
| Qwen3-VL-EmbeddingDim.=2048, Zero-shot=true2026.04 | 28.46 | 58.87 | 25.67 | 24.66 | |
| FashionCLIPDim.=512, Zero-shot=true2026.04 | 16.08 | 19.68 | 14.03 | 11.4 | |
| CASLIE-SDim.=3072, Zero-shot=true2026.04 | 15.93 | 27.88 | 11.12 | 7.99 | |
| InternVL3.5-2BDim.=2048, Zero-shot=true2026.04 | 7.84 | 16.61 | 7.87 | 4.78 | |
| Qwen3-VL-2BDim.=2048, Zero-shot=true2026.04 | 4.83 | 8.55 | 4.33 | 1.7 | |
| SigLIP2Dim.=3072, Zero-shot=true2026.04 | 1.47 | 1.88 | 1.83 | 0.53 |