World Knowledge on JARVIS-VLA Benchmark 1.0 (test)
96.6AccuracyGPT-4o
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-4o2025.03 | 96.6 | 1 | |
| GPT-4o-mini2025.03 | 75.9 | 2 | |
| JARVIS-VLA-Qwen2-VLModel Size=7B2025.03 | 70.7 | 3 | |
| Qwen2-VL (Grounding)Model Size=7B2025.03 | 67.2 | 4 | |
| Qwen2-VL (Knowledge)Model Size=7B2025.03 | 65.5 | 5 | |
| Qwen2-VL (Vision)Model Size=7B2025.03 | 62.1 | 6 | |
| Llama-3.2Model Size=11B2025.03 | 20.7 | 7 | |
| Llava-NextModel Size=8B2025.03 | 19 | 8 | |
| Qwen2-VLModel Size=7B2025.03 | 17.3 | 9 | |
| Molmo-d-0924Model Size=7B2025.03 | 12.1 | 10 |