Geometric Problem Solving on GeoTrust (test)
45.83AccuracyOpenAI-o3
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OpenAI-o3#Params=-2025.04 | 45.83 | 110 | |
| OpenAI-o3Release Date=Apr, 20252025.04 | 45.83 | — | |
| Intern-S1#Params=235B+6B2025.04 | 43.33 | 104 | |
| Gemini-2.5-pro#Params=-2025.04 | 43.33 | 104 | |
| Intern-S1Release Date=Jul, 20252025.04 | 43.33 | — | |
| Gemini-2.5-proRelease Date=Jun, 20252025.04 | 43.33 | — | |
| DeepSeek-R1#Params=671B, input_format=only natural language questions, no images2025.04 | 37.08 | 89 | |
| Qwen2.5-VL-72B#Params=72B2025.04 | 28.33 | 68 | |
| Qwen2.5-VL-72BRelease Date=Jan, 20252025.04 | 28.33 | — | |
| Claude-3.7-sonnet#Params=-2025.04 | 27.5 | 66 | |
| Claude-3.7-sonnetRelease Date=Feb, 20252025.04 | 27.5 | — | |
| GPT-4o#Params=-2025.04 | 25.83 | 62 | |
| GPT-4oRelease Date=May, 20242025.04 | 25.83 | — | |
| Qwen2-VL-7B#Params=7B2025.04 | 4.58 | 11 | |
| LLaVA-1.5-7B#Params=7B2025.04 | 1.67 | 4 |