Visual Counting on PixMo-Count (test)
90.2ScoreEagle2.5-8B
Evaluation results
| Method | Links | |
|---|---|---|
| Eagle2.5-8BModel Category=Open weights only2026.01 | 90.2 | |
| Gemini 3 ProModel Category=API call only2026.01 | 90 | |
| Molmo2-O-7BModel Category=Molmo2 family2026.01 | 88.9 | |
| Molmo2-8BModel Category=Molmo2 family2026.01 | 88.5 | |
| Molmo2-4BModel Category=Molmo2 family2026.01 | 88.1 | |
| Molmo-72BNumber of crops=362024.09 | 85.2 | |
| Molmo-72BModel Category=Molmo1 family2026.01 | 85.2 | |
| Molmo-7B-DNumber of crops=362024.09 | 84.8 | |
| Molmo-7B-DModel Category=Molmo1 family2026.01 | 84.8 | |
| Molmo-7B-ONumber of crops=362024.09 | 83.3 | |
| Molmo-7B-OModel Category=Molmo1 family2026.01 | 83.3 | |
| MolmoE-1BNumber of crops=362024.09 | 79.6 | |
| MolmoE-1BModel Category=Molmo1 family2026.01 | 79.6 | |
| GPT-5 miniModel Category=API call only2026.01 | 74.4 | |
| Gemini 2.5 ProModel Category=API call only2026.01 | 73.8 | |
| PLM-8BModel Category=Open models2026.01 | 68 | |
| GPT-5Model Category=API call only2026.01 | 67.2 | |
| Qwen3-VL-8BModel Category=Open weights only2026.01 | 65 | |
| Gemini 1.5 Pro2024.09 | 64.3 | |
| Gemini 2.5 FlashModel Category=API call only2026.01 | 63.9 | |
| PLM-3BModel Category=Open models2026.01 | 63 | |
| MiniCPM-V-4.5-8BModel Category=Open weights only2026.01 | 62.8 | |
| InternVL3.5-4BModel Category=Open weights only2026.01 | 62.4 | |
| InternVL3.5-8BModel Category=Open weights only2026.01 | 61.9 | |
| Gemini 1.5 Flash2024.09 | 61.1 | |
| LLaVA OneVision-72Bdistilled=true2024.09 | 60.7 | |
| GLM-4.1V-9BModel Category=Open weights only2026.01 | 60.7 | |
| PaliGemma-mix-3B2024.09 | 60 | |
| GPT-4o-05132024.09 | 59.6 | |
| Llama-3.2V-90B-Instruct2024.09 | 58.5 | |
| Claude-3.5 Sonnet2024.09 | 58.3 | |
| Claude Sonnet 4.5Model Category=API call only2026.01 | 58.3 | |
| Qwen3-VL-4BModel Category=Open weights only2026.01 | 58 | |
| Keye-VL-1.5-8BModel Category=Open weights only2026.01 | 57.4 | |
| Qwen2-VL-72B2024.09 | 55.7 | |
| InternVL2-Llama-3-76B2024.09 | 54.6 | |
| LLaVA OneVision-7Bdistilled=true2024.09 | 54.4 | |
| Pixtral-12B2024.09 | 51.7 | |
| Cambrian-1-34Bdistilled=true2024.09 | 50.7 | |
| xGen-MM-interleave-4Bdistilled=true2024.09 | 50.2 | |
| Qwen2-VL-7B2024.09 | 48 | |
| Llama-3.2V-11B-Instruct2024.09 | 47.4 | |
| Cambrian-1-8Bdistilled=true2024.09 | 46.6 | |
| GPT-4V2024.09 | 45 | |
| Claude-3 Haiku2024.09 | 43.9 | |
| InternVL2-8B2024.09 | 43.9 | |
| Claude-3 Opus2024.09 | 43.3 | |
| Phi3.5-Vision-4B2024.09 | 38.3 | |
| LLaVA-1.5-13B2024.09 | 35.2 | |
| LLaVA-1.5-7B2024.09 | 27.6 |