List your company

Visual Question Answering on SpecVQA

77.82Accuracy (English Descriptive L0)Gemini-3-Flash-Preview
45.3253.757562.19570.6325Apr 30, 2026

Evaluation results

MethodLinks
Gemini-3-Flash-PreviewThink=✓, Weight=Proprietary, API-Version=202512172026.0477.8277.5980.477978.72
Gemini-3-Pro-PreviewThink=✓, Weight=Proprietary, API-Version=202511192026.0477.1877.5979.3977.3177.87
Gemini-2.5-ProThink=✓, Weight=Proprietary, API-Version=202506172026.0476.4574.8677.5875.7176.15
Gemini-2.5-FlashThink=✓, Weight=Proprietary, API-Version=202506172026.0473.9570.4374.7371.8572.74
GPT-o4miniThink=✓, Weight=Proprietary, API-Version=202504162026.0471.4468.3672.3769.9670.54
GPT-5(high)Think=✓, Weight=Proprietary, API-Version=202508072026.0470.1769.5971.1571.4770.59
GPT-o3Think=✓, Weight=Proprietary, API-Version=202504162026.0469.537170.2770.4370.31
GPT-5(medium)Think=✓, Weight=Proprietary, API-Version=202508072026.0469.2369.7771.547170.39
GPT-5(low)Think=✓, Weight=Proprietary, API-Version=202508072026.0468.2569.6870.6669.8769.61
GPT-5.1Think=×, Weight=Proprietary, API-Version=202511132026.0467.7663.4768.9962.965.78
GPT-5.2Think=×, Weight=Proprietary, API-Version=202512112026.0467.7663.2868.9961.5865.4
Claude-4.5-SonnetThink=✓, Weight=Proprietary, API-Version=202509292026.0461.4855.1863.1557.8259.41
Doubao-seed-1-6-flashThink=✓, Weight=Proprietary, API-Version=202508282026.0460.656.8761.4855.7458.67
Claude-4-SonnetThink=✓, Weight=Proprietary, API-Version=202505142026.0459.4752.8259.5755.6556.88
Qwen3-VL-8B-ThinkingThink=✓, Weight=Open2026.0458.6453.4858.0555.0856.31
Doubao-seed-1-6-250615Think=✓, Weight=Proprietary, API-Version=202506152026.0457.2154.9957.3654.5256.02
Qwen3-VL-8B-InstructThink=×, Weight=Open2026.0457.2142.5659.2747.2751.58
Doubao-seed-1-6Think=×, Weight=Proprietary, API-Version=202506152026.0455.344.3556.9745.8650.62
Qwen3-Omni-30B-A3B-ThinkingThink=✓, Weight=Open2026.0454.4248.6853.6847.6551.11
DeepSeek-VL2Think=×, Weight=Open2026.0446.5731.8340.9230.7937.53