Multimodal Understanding on SEED-Bench SEED-I
87.7AccuracyUIO-2-XXL-6.8B
Evaluation results
| Method | Links | |
|---|---|---|
| UIO-2-XXL-6.8BParameters=6.8B2024.06 | 87.7 | |
| SPHINX-7BParameters=7B2024.06 | 86.9 | |
| BLIP2-13BParameters=13B2024.06 | 85.3 | |
| LLaVA-7BParameters=7B2024.06 | 80.2 | |
| InstructBLIP-13BParameters=13B2024.06 | 78.9 | |
| TroL-7BParameters=7B2024.06 | 75.3 | |
| SPHINX-Plus-13BParameters=13B2024.06 | 74.8 | |
| IDEFICS-9BParameters=9B2024.06 | 74.6 | |
| SPHINX-MoE-7Bx8Architecture=MoE, Parameters=7Bx82024.06 | 73 | |
| Otter-7BParameters=7B2024.06 | 72.5 | |
| LLaVA-NeXT-13BParameters=13B2024.06 | 72.2 | |
| MM1-MoE-7Bx32Architecture=MoE, Parameters=7Bx322024.06 | 70.9 | |
| MM1-7BParameters=7B2024.06 | 69.9 | |
| ShareGPT4V-7BParameters=7B2024.06 | 69.7 | |
| InternLM-XC-7BParameters=7B2024.06 | 66.1 | |
| VILA-13BParameters=13B2024.06 | 62.8 | |
| LLaVA1.5-13BParameters=13B2024.06 | 61.6 | |
| VILA-7BParameters=7B2024.06 | 61.1 | |
| LLaVA1.5-7BParameters=7B2024.06 | 58.6 | |
| InstructBLIP-7BParameters=7B2024.06 | 53.6 |