Embodied AI Behavior Modeling on Embodied Agent Interface Behavior task
74.9Performanceo1-preview
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| o1-preview2026.04 | 74.9 | 81.6 | 81 | 91 | 57 | 62 | 70.8 | |
| ReCAPA2026.04 | 72.2 | 84.8 | 77 | 84 | 53 | 60 | 69.8 | |
| Claude-4-Sonnet2026.04 | 68.5 | 84.3 | 68 | 75 | 47 | 52 | 69.2 | |
| Claude-3.5-Sonnet2026.04 | 64.2 | 82.7 | 60 | 69 | 39 | 44 | 67.9 | |
| Claude-3-Opus2026.04 | 60.4 | 77 | 51 | 59 | 41 | 47 | 63.4 | |
| GPT-4o2026.04 | 59.8 | 79.2 | 47 | 53 | 49 | 55 | 60.9 | |
| o1-mini2026.04 | 57.5 | 76.4 | 56 | 65 | 31 | 39 | 56.4 | |
| Claude-3-Sonnet2026.04 | 55.1 | 69.4 | 44 | 57 | 39 | 43 | 56.2 | |
| Gemini-1.5-Flash2026.04 | 52.1 | 74.8 | 40 | 52 | 34 | 42 | 53.4 | |
| Mistral-Large2026.04 | 50.4 | 74.3 | 33 | 50 | 31 | 38 | 49.5 |