Scientific Chart Understanding on CharXiv 1.0
60.2RQ ScoreClaude-3.5-Sonnet
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Claude-3.5-Sonnet2024.12 | 60.2 | 84.3 | |
| GPT-4o-202405132024.12 | 47.1 | 84.5 | |
| Gemini-1.5-Pro2024.12 | 43.3 | 72 | |
| InternVL2.5-38B2024.12 | 42.4 | 79.6 | |
| InternVL2.5-78B2024.12 | 42.4 | 82.3 | |
| InternVL2-Llama3-76B2024.12 | 38.9 | 75.2 | |
| GPT-4V2024.12 | 37.1 | 79.9 | |
| InternVL2.5-26B2024.12 | 35.9 | 73.5 | |
| InternVL2-26B2024.12 | 33.4 | 62.4 | |
| InternVL2.5-8B2024.12 | 32.9 | 68.6 | |
| InternVL2-40B2024.12 | 32.3 | 66 | |
| InternVL2-8B2024.12 | 31.2 | 56.1 | |
| MiniCPM-V2.62024.12 | 31 | 57.1 | |
| Claude-3-Opus2024.12 | 30.2 | 71.6 | |
| InternVL-Chat-V1.52024.12 | 29.2 | 58.5 | |
| Cambrian-34B2024.12 | 27.3 | 59.7 | |
| InternVL2.5-4B2024.12 | 24.9 | 61.7 | |
| InternVL2-4B2024.12 | 24.5 | 48 | |
| VILA-1.5-40B2024.12 | 24 | 38.7 | |
| InternVL2.5-2B2024.12 | 21.3 | 49.7 | |
| InternVL2-2B2024.12 | 21 | 40.6 | |
| InternVL2.5-1B2024.12 | 19 | 38.4 | |
| InternVL2-1B2024.12 | 18.1 | 30.7 |