List your company
ResearchFormerly WizWand

Vision-Language Compositionality on VisMin Hard (test)

84.47Text Score (T)Qwen2.5-VL-7B + FOCUS
-1.610820.737143.08565.4329Aug 19, 2025
Updated 4mo ago

Evaluation results

MethodLinks
Qwen2.5-VL-7B + FOCUSModel Family=Qwen2.5-VL, Model Size=7B, Evaluation State=Frozen2025.0884.4761.4456.99
Qwen2.5-VL-7BModel Family=Qwen2.5-VL, Model Size=7B, Evaluation State=Frozen2025.0884.3753.2649.97
Qwen3-VL-4B + FOCUSModel Family=Qwen3-VL, Model Size=4B, Evaluation State=Frozen2025.0884.1158.3154.32
Qwen3-VL-4BModel Family=Qwen3-VL, Model Size=4B, Evaluation State=Frozen2025.0883.6249.6246.78
InternVL3-8BModel Family=InternVL3, Model Size=8B, Evaluation State=Frozen2025.0882.8647.6644.8
Qwen3-VL-8BModel Family=Qwen3-VL, Model Size=8B, Evaluation State=Frozen2025.0882.8656.6552.95
Qwen3-VL-8B + FOCUSModel Family=Qwen3-VL, Model Size=8B, Evaluation State=Frozen2025.0882.7759.1355.01
InternVL3-8B + FOCUSModel Family=InternVL3, Model Size=8B, Evaluation State=Frozen2025.0882.5452.6648.89
LLaVA-OneVision-7BModel Family=LLaVA-OV, Model Size=7B, Evaluation State=Frozen2025.0880.6144.4238.4
LLaVA-OneVision-7B + FOCUSModel Family=LLaVA-OV, Model Size=7B, Evaluation State=Frozen2025.0880.4457.8949.4
Qwen2.5-VL-3B + FOCUSModel Family=Qwen2.5-VL, Model Size=3B, Evaluation State=Frozen2025.0878.228.8625.29
Qwen2.5-VL-3BModel Family=Qwen2.5-VL, Model Size=3B, Evaluation State=Frozen2025.0877.3827.0922.93
InternVL3-2BModel Family=InternVL3, Model Size=2B, Evaluation State=Frozen2025.0865.536.846.17
InternVL3-2B + FOCUSModel Family=InternVL3, Model Size=2B, Evaluation State=Frozen2025.0864.8726.7723.96
LLaVA-OneVision-0.5B + FOCUSModel Family=LLaVA-OV, Model Size=0.5B, Evaluation State=Frozen2025.082.218.410.59
LLaVA-OneVision-0.5BModel Family=LLaVA-OV, Model Size=0.5B, Evaluation State=Frozen2025.081.720.120.51