e-Commerce on eComMMMU (test)
58.3eComMMMU ScoreSigLIP2 | Lilium-8B
Evaluation results
| Method | Links | |
|---|---|---|
| SigLIP2 | Lilium-8BVision Encoder=SigLIP2, LLM=Lilium-8B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 58.3 | |
| Qwen2.5ViT | e-Llama3.1-8BVision Encoder=Qwen2.5ViT, LLM=e-Llama3.1-8B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 55.4 | |
| SigLIP2 | e-Llama3.1-8BVision Encoder=SigLIP2, LLM=e-Llama3.1-8B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 52.2 | |
| LLaVA-OVVision Encoder=SigLIP, LLM=Qwen2-7B, Model Adaptation Type=Open Source2026.02 | 50.8 | |
| SigLIP2 | Qwen-3-8BVision Encoder=SigLIP2, LLM=Qwen-3-8B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 50 | |
| SigLIP2 | Lilium-1BVision Encoder=SigLIP2, LLM=Lilium-1B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 48.6 | |
| Qwen3-VLVision Encoder=Qwen3ViT, LLM=Qwen3-8B, Model Adaptation Type=Open Source2026.02 | 47.6 | |
| SigLIP2 | Llama-3.1-8BVision Encoder=SigLIP2, LLM=Llama-3.1-8B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 46.9 | |
| SigLIP2 | Lilium-4BVision Encoder=SigLIP2, LLM=Lilium-4B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 46.5 | |
| SigLIP | Gemma3-4BVision Encoder=SigLIP, LLM=Gemma3-4B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 45.4 | |
| Qwen2.5-VLVision Encoder=Qwen2.5ViT, LLM=Qwen2-7B, Model Adaptation Type=Open Source2026.02 | 40.6 | |
| Gemma3Vision Encoder=SigLIP, LLM=Gemma3-4B, Model Adaptation Type=Open Source2026.02 | 34.7 | |
| SigLIP2 | Qwen-3-4BVision Encoder=SigLIP2, LLM=Qwen-3-4B, Model Adaptation Type=Internal E-commerce Adaptation2026.02 | 20.9 |