Mathematical function reasoning on IsoBench Math
94.9ConvexityGPT-4o + Sketchpad
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-4o + SketchpadVisual Input=true, Sketchpad=true2024.06 | 94.9 | 94.7 | |
| Gemini-ProVisual Input=false2024.06 | 87.9 | 48.2 | |
| GPT-4oVisual Input=true, Sketchpad=false2024.06 | 87.2 | 84.4 | |
| Claude 3 OPUSVisual Input=false2024.06 | 77.6 | 74.4 | |
| GPT-4 Turbo + SketchpadVisual Input=true, Sketchpad=true2024.06 | 77.3 | 71.5 | |
| LLaMA-2-70BVisual Input=false2024.06 | 74.2 | 33.3 | |
| Mixtral 8x7BVisual Input=false2024.06 | 69.1 | 41.7 | |
| GPT-4 TurboVisual Input=true, Sketchpad=false2024.06 | 57 | 80.5 |