Object state change reasoning on ObjChangeVR Short Trajectory
82.2EM@0.8ObjChangeVR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ObjChangeVRModel=GPT-4o2026.02 | 82.2 | 83 | 83.7 | |
| ObjChangeVRModel=Gemini 2.0 Flash2026.02 | 78.6 | 80.6 | 81.1 | |
| ObjChangeVRModel=GPT-4o mini2026.02 | 69.6 | 69.2 | 69.9 | |
| Viewpoint-RetrievalModel=Gemini 2.0 Flash2026.02 | 65.3 | 67.7 | 67.2 | |
| Image-CLIPModel=Gemini 2.0 Flash2026.02 | 64.3 | 66.7 | 66.1 | |
| Viewpoint-RetrievalModel=GPT-4o2026.02 | 62.3 | 65.9 | 65.7 | |
| Image-CLIPModel=GPT-4o2026.02 | 61.6 | 64.9 | 64.4 | |
| Caption-CLIPModel=GPT-4o2026.02 | 52.9 | 59.5 | 58.8 | |
| Caption-CLIPModel=Gemini 2.0 Flash2026.02 | 47.8 | 49.3 | 45.3 | |
| Image-CLIPModel=GPT-4o mini2026.02 | 47.2 | 43 | 38.1 | |
| Viewpoint-RetrievalModel=GPT-4o mini2026.02 | 47.2 | 43.5 | 38.8 | |
| Caption-CLIPModel=GPT-4o mini2026.02 | 41.6 | 39.5 | 35.7 |