Object state change reasoning on ObjChangeVR Long Trajectory
65.2EM@0.8ObjChangeVR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ObjChangeVRModel=GPT-4o2026.02 | 65.2 | 66.1 | 66.9 | |
| ObjChangeVRModel=Gemini 2.0 Flash2026.02 | 60.4 | 61.5 | 62.4 | |
| Viewpoint-RetrievalModel=Gemini 2.0 Flash2026.02 | 59 | 59.4 | 60.5 | |
| ObjChangeVRModel=GPT-4o mini2026.02 | 58.9 | 57.3 | 57.9 | |
| Viewpoint-RetrievalModel=GPT-4o2026.02 | 57 | 58.4 | 59.9 | |
| Image-CLIPModel=Gemini 2.0 Flash2026.02 | 56.3 | 57.1 | 58.2 | |
| Image-CLIPModel=GPT-4o2026.02 | 55.8 | 57.2 | 58.5 | |
| Caption-CLIPModel=GPT-4o mini2026.02 | 53.7 | 44.9 | 46.8 | |
| Caption-CLIPModel=GPT-4o2026.02 | 52.8 | 52.2 | 53.7 | |
| Viewpoint-RetrievalModel=GPT-4o mini2026.02 | 52.7 | 47.1 | 49.1 | |
| Image-CLIPModel=GPT-4o mini2026.02 | 51.3 | 45.9 | 47.9 | |
| Caption-CLIPModel=Gemini 2.0 Flash2026.02 | 44 | 43 | 45.3 |