Causal-order reasoning on VCR-Causal
98.17AccuracyHuman Estimate
Evaluation results
| Method | Links | |
|---|---|---|
| Human Estimate2025.06 | 98.17 | |
| LLaVA 1.6Model Category=Text-Generation Models2025.06 | 57.24 | |
| Vicuna 1.5Model Category=Text-Generation Models2025.06 | 56.03 | |
| RobustCLIPModel Category=Score-Based Models2025.06 | 53.68 | |
| LLaVA 1.5Model Category=Text-Generation Models2025.06 | 52.12 | |
| CLIP ViT L/14Model Category=Score-Based Models2025.06 | 51.66 | |
| NegCLIPModel Category=Score-Based Models2025.06 | 51.3 | |
| BLIP2 FEModel Category=Score-Based Models, Note=BLIP2 feature extractor model2025.06 | 50.76 | |
| BLIP ITM BaseModel Category=Score-Based Models2025.06 | 50.66 | |
| CLIP ViT B/32Model Category=Score-Based Models2025.06 | 50.35 | |
| Random2025.06 | 50 | |
| FLAVAModel Category=Score-Based Models2025.06 | 49.99 | |
| BLIP2 ITMModel Category=Score-Based Models2025.06 | 49.95 | |
| BLIP ITM LargeModel Category=Score-Based Models2025.06 | 47.99 | |
| Qwen2.5-VLModel Category=Text-Generation Models2025.06 | 47.26 | |
| Qwen3-VLModel Category=Text-Generation Models2025.06 | 43.73 |