Causal-order reasoning on VQA-Causal
99.17AccuracyHuman Estimate
Evaluation results
| Method | Links | |
|---|---|---|
| Human Estimate2025.06 | 99.17 | |
| LLaVA 1.6Model Category=Text-Generation Models2025.06 | 58.11 | |
| LLaVA 1.5Model Category=Text-Generation Models2025.06 | 53.19 | |
| CLIP ViT B/32Model Category=Score-Based Models2025.06 | 51.62 | |
| BLIP2 FEModel Category=Score-Based Models, Note=BLIP2 feature extractor model2025.06 | 51.51 | |
| NegCLIPModel Category=Score-Based Models2025.06 | 50.89 | |
| Vicuna 1.5Model Category=Text-Generation Models2025.06 | 50.86 | |
| BLIP2 ITMModel Category=Score-Based Models2025.06 | 50.76 | |
| CLIP ViT L/14Model Category=Score-Based Models2025.06 | 50.74 | |
| RobustCLIPModel Category=Score-Based Models2025.06 | 50.66 | |
| Qwen2.5-VLModel Category=Text-Generation Models2025.06 | 50.66 | |
| Random2025.06 | 50 | |
| BLIP ITM BaseModel Category=Score-Based Models2025.06 | 48.94 | |
| BLIP ITM LargeModel Category=Score-Based Models2025.06 | 48.68 | |
| FLAVAModel Category=Score-Based Models2025.06 | 48.52 | |
| Qwen3-VLModel Category=Text-Generation Models2025.06 | 42.01 |