List your company
ResearchFormerly WizWand

Diagram Understanding on AI2D 1.0 (test)

96.3AccuracyMolmo-72B
55.53266.11676.787.284Dec 6, 2024
Updated 8mo ago

Evaluation results

MethodLinks
Molmo-72Bmasking=without2024.1296.3
InternVL2.5-78Bmasking=without2024.1295.7
InternVL2.5-38Bmasking=without2024.1295.1
InternVL2-Llama3-76Bmasking=without2024.1294.8
Claude-3.5-Sonnetmasking=without2024.1294.7
InternVL2-40Bmasking=without2024.1294.5
InternVL2.5-26Bmasking=without2024.1294.4
Gemini-1.5-Promasking=without2024.1294.4
GPT-4o-20240513masking=without2024.1294.2
NVLM-D-72Bmasking=without2024.1294.2
Molmo-7B-Dmasking=without2024.1293.2
InternVL2.5-8Bmasking=without2024.1292.8
InternVL2-26Bmasking=without2024.1292.5
Qwen2-VL-7Bmasking=without2024.1292.1
InternVL2-8Bmasking=without2024.1291.7
InternVL2.5-4Bmasking=without2024.1290.5
InternVL-Chat-V1.5masking=without2024.1289.8
GPT-4Vmasking=without2024.1289.4
InternVL2.5-78Bmasking=with2024.1289.1
Claude-3-Opusmasking=without2024.1288.1
Qwen2-VL-72Bmasking=with2024.1288.1
InternVL2-4Bmasking=without2024.1287.8
Phi-3.5-Vision-4Bmasking=without2024.1287.6
InternVL2.5-38Bmasking=with2024.1287.6
InternVL2-Llama3-76Bmasking=with2024.1287.6
InternVL2-40Bmasking=with2024.1286.6
InternVL2.5-26Bmasking=with2024.1286.4
LLaVA-OneVision-72Bmasking=with2024.1285.6
NVLM-D-72Bmasking=with2024.1285.2
Qwen2-VL-2Bmasking=without2024.1284.6
GPT-4o-20240513masking=with2024.1284.6
InternVL2.5-8Bmasking=with2024.1284.5
InternVL2-26Bmasking=with2024.1284.5
Ovis1.6-Gemma2-9Bmasking=with2024.1284.4
InternVL2-8Bmasking=with2024.1283.8
InternVL2.5-2Bmasking=without2024.1283.5
Qwen2-VL-7Bmasking=with2024.1283
InternVL2-2Bmasking=without2024.1282.3
MiniCPM-V2.6masking=with2024.1282.1
InternVL2.5-4Bmasking=with2024.1281.4
Claude-3.5-Sonnetmasking=with2024.1281.2
InternVL-Chat-V1.5masking=with2024.1280.7
Cambrian-34Bmasking=with2024.1279.5
Gemini-1.5-Promasking=with2024.1279.1
InternVL2-4Bmasking=with2024.1278.9
GPT-4Vmasking=with2024.1278.2
InternVL2.5-1Bmasking=without2024.1277.8
Phi-3.5-Vision-4Bmasking=with2024.1277.8
Aquila-VL-2Bmasking=with2024.1275
InternVL2.5-2Bmasking=with2024.1274.9
Qwen2-VL-2Bmasking=with2024.1274.7
InternVL2-2Bmasking=with2024.1274.1
Claude-3-Opusmasking=with2024.1270.6
InternVL2-1Bmasking=without2024.1270.5
VILA-1.5-40Bmasking=with2024.1269.9
InternVL2.5-1Bmasking=with2024.1269.3
InternVL2-1Bmasking=with2024.1264.1
LLaVA-OneVision-0.5Bmasking=with2024.1257.1