Object Removal on COCO subset (test)
47S2 ScoreVISTA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| VISTAVisual Encoder=DINOv2, LLM Backbone=Gemma-2-2B-it2026.05 | 47 | 49 | 4 | 1.43 | |
| VisionSAEVisual Encoder=CLIP Local2026.05 | 24 | 23 | 53 | 0.71 | |
| VISTAVisual Encoder=CLIP - Gemma 2B, LLM Backbone=Gemma-2-2B-it2026.05 | 18 | 4 | 78 | 0.4 | |
| Ablation (No SAE)Visual Encoder=CLIP2026.05 | 13 | 20 | 67 | 0.46 | |
| VisionSAEVisual Encoder=CLIP Global2026.05 | 11 | 84 | 5 | 1.06 | |
| Ablation (No SAE)Visual Encoder=DINOv22026.05 | 10 | 2 | 88 | 0.22 | |
| Ablation (No SAE)Visual Encoder=I-JEPA2026.05 | 8 | 18 | 74 | 0.34 | |
| VISTAVisual Encoder=I-JEPA - Gemma 2B, LLM Backbone=Gemma-2-2B-it2026.05 | 8 | 25 | 67 | 0.41 | |
| PatchSAEVisual Encoder=CLIP Local2026.05 | 5 | 55 | 40 | 0.65 |