List your company

Document Visual Question Answering on NiM-Benchmark

0.63Score (Menus)GPT-4o
0.09960.23730.3750.5127Aug 7, 2025

Evaluation results

MethodLinks
GPT-4oSpot-IT=true2025.080.63———0.670.780.520.60.450.62
GPT-4oSpot-IT=false2025.080.55———0.610.710.490.550.390.56
GPT-4oSpot-IT=true2025.080.5———0.660.770.440.560.370.56
GPT-4o-miniSpot-IT=true2025.080.49———0.460.670.460.510.40.5
GPT-4oSpot-IT=true2025.080.47———0.510.640.330.460.290.46
Gemini-1.5-FlashSpot-IT=true2025.080.4———0.460.390.320.410.490.4
GPT-4o-miniSpot-IT=true2025.080.38———0.410.640.370.490.360.44
GPT-4o-miniSpot-IT=true2025.080.37———0.260.490.30.390.270.35
Gemini-1.5-FlashSpot-IT=true2025.080.35———0.230.20.160.340.410.27
GPT-4oSpot-IT=false2025.080.35———0.590.720.390.50.310.48
Gemini-1.5-FlashSpot-IT=true2025.080.35———0.360.290.20.40.470.34
GPT-4o-miniSpot-IT=false2025.080.35———0.440.640.450.470.370.46
GPT-4oSpot-IT=false2025.080.33———0.410.550.280.420.260.38
Gemini-1.5-FlashSpot-IT=false2025.080.29———0.40.350.320.470.420.37
Qwen2-7BSpot-IT=true2025.080.27———0.240.060.10.040.20.15
Qwen2-7BSpot-IT=true2025.080.26———0.320.170.230.110.230.22
GPT-4o-miniSpot-IT=false2025.080.25———0.230.470.240.340.240.29
GPT-4o-miniSpot-IT=false2025.080.25———0.380.620.350.420.320.38
Gemini-1.5-FlashSpot-IT=false2025.080.22———0.170.190.140.30.340.22
Gemini-1.5-FlashSpot-IT=false2025.080.22———0.290.250.20.360.40.28
Qwen2-7BSpot-IT=true2025.080.21———0.150.030.070.040.20.11
Qwen2-7BSpot-IT=false2025.080.19———0.290.180.250.080.160.19
Qwen2-7BSpot-IT=false2025.080.16———0.190.070.110.010.120.1
Qwen2-7BSpot-IT=false2025.080.12———0.110.050.060.010.110.07