Compositional Understanding on SugarCrepe++ (test)
63.67AccuracyQwen2.5-VL-7B + SSL-R1
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2.5-VL-7B + SSL-R1Model Scale=7B, Training Strategy=+ SSL-R12026.04 | 63.67 | |
| VL-Cogito-7BModel Scale=7B, Training Strategy=Representative Reasoning Model2026.04 | 63.59 | |
| Qwen2.5-VL-7B + Visual JigsawModel Scale=7B, Training Strategy=+ Visual Jigsaw2026.04 | 63.04 | |
| LLaVA-Critic-R1-7BModel Scale=7B, Training Strategy=Representative Reasoning Model2026.04 | 61.93 | |
| Qwen2.5-VL-7BModel Scale=7B, Training Strategy=Baseline2026.04 | 61.59 | |
| ThinkLite-VL-7BModel Scale=7B, Training Strategy=Representative Reasoning Model2026.04 | 61.49 | |
| Qwen2.5-VL-3B + SSL-R1Model Scale=3B, Training Strategy=+ SSL-R12026.04 | 61.49 | |
| Qwen2.5-VL-3BModel Scale=3B, Training Strategy=Baseline2026.04 | 61.05 | |
| Qwen2.5-VL-3B + Visual JigsawModel Scale=3B, Training Strategy=+ Visual Jigsaw2026.04 | 60.21 |