Referring Expression Grounding on Ferret-Bench
77.1Accuracy (avg)MM1.5-30B
Evaluation Results
| Method | Links | |
|---|---|---|
| MM1.5-30BModel Size Category=Larger (>13B)2024.09 | 77.1 | |
| Ferret-V2-7BModel Size Category=7B2024.09 | 75.6 | |
| Ferret-V2-13BModel Size Category=Larger (>13B)2024.09 | 74.9 | |
| MM1.5-7BModel Size Category=7B2024.09 | 72.6 | |
| MM1.5-3B-MoEModel Size Category=3B, Architecture=MoE2024.09 | 72.2 | |
| MM1.5-1B-MoEModel Size Category=1B, Architecture=MoE2024.09 | 69.6 | |
| MM1.5-3BModel Size Category=3B2024.09 | 69.5 | |
| MM1.5-1BModel Size Category=1B2024.09 | 67.4 | |
| Ferret-13BModel Size Category=Larger (>13B)2024.09 | 66.3 | |
| Ferret-7BModel Size Category=7B2024.09 | 64.5 | |
| MM1-30BModel Size Category=Larger (>13B)2024.09 | 50.9 | |
| MM1-7BModel Size Category=7B2024.09 | 48.5 | |
| SPHINX-TinyModel Size Category=1B2024.09 | 47.3 | |
| MM1-3BModel Size Category=3B2024.09 | 46.3 | |
| LLaVA-OneVision-7BModel Size Category=7B2024.09 | 38.4 | |
| InternVL2Model Size Category=3B2024.09 | 35 | |
| Phi-3-Vision-4BModel Size Category=3B2024.09 | 32.2 | |
| MiniCPM-v2-3BModel Size Category=3B2024.09 | 22.1 |