Negation Understanding on SimpleNeg COCO 2014 1.0 (val)
54.3Qwen3-VL-32B Top-1 AccuracySteering
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| SteeringBackbone=ViT-B/32, # Negation Training Data=4K, Without Finetuning?=true2026.03 | 54.3 | 53.3 | 98 | 53.7 | 51.7 | 94 | 54 | 51.5 | 94.1 | |
| CLIP-CC12MBackbone=ViT-B/32, # Negation Training Data=12M, Without Finetuning?=false2026.03 | 53.1 | 49.8 | 88 | 55.9 | 50.8 | 89.3 | 55 | 50 | 88.3 | |
| NegCLIPBackbone=ViT-B/32, # Negation Training Data=120K, Without Finetuning?=false2026.03 | 46 | 45.7 | 83.1 | 47.7 | 46.7 | 84.8 | 48.1 | 46.8 | 84.2 | |
| BaselineBackbone=ViT-B/322026.03 | 44.9 | 44.9 | 84.7 | 46 | 45.2 | 84.6 | 46.9 | 45 | 85.4 | |
| ConCLIPBackbone=ViT-B/32, # Negation Training Data=228K, Without Finetuning?=false2026.03 | 30.7 | 30.2 | 63.8 | 31.7 | 30.5 | 64.6 | 30.9 | 30.3 | 63.9 |