Visual Question Answering on XLRS-Bench L-3 Capability (test)

61.7OCQwen3-VL-235B-A22B

Evaluation results

Method
Qwen3-VL-235B-A22B2026.05	61.7	82.5	38.6	36.7	44	39	38.9	49	73	82	37.8	33.3	48	51.1
Gemini 2.0 Flash2026.04	41.7	45	38	73.5	34.6	27.6	61.7	32	73	82	43	30	51	39.5
ScaleEarth2026.05	41.7	52.3	44.8	78.6	56.2	53.4	66.1	39.7	75.2	81.6	57.3	49.1	50.2	57.4
InternVL3-8B2026.04	40	39	10	71.5	44.5	30.8	65	25.2	77	82	36	21.7	50	40.3
InternVL3-8B2026.05	40	39	10	71.5	44.5	30.8	65	25.2	77	82	36	21.7	50	45.6
InternVL2.5-8B2026.04	38.3	37	10	77	33.4	35.5	65	21.6	73	83	34	50	43	38.5
GeoEyes2026.05	38.3	40	24	73.5	59.5	66.1	68.3	32.2	77	80	56	40	50	54.2
InternVL2.5-8B2026.05	38.3	37	10	77	33.4	35.5	65	21.6	73	83	34	50	43	46.2
Qwen2.5-VL-7B2026.04	33.3	40	31	77	40.6	40.5	66.7	36.2	68	72	27	38.3	45	43.8
LLaVA-OneVision-72B2026.04	33.3	38	15	72.5	36.3	36.3	66.7	35.6	74	83	28	36.7	43	41.1
Qwen2.5-VL-7B2026.05	33.3	40	31	77	40.6	40.5	66.7	36.2	68	72	27	38.3	45	47.4
Qwen2.5-VL-72B2026.05	33.3	47	39	80	45.3	42.1	65	34	71	74	37	43.3	42	50.2
DeepEyes2026.05	31.7	41	33	75	41.6	38.1	68.3	31.4	70	78	46	50	46	50
GPT-5.22026.05	30	37	17	70.5	43	41.4	68.3	34	74	76	52	36.7	38	47.5
Claude 3.7 Sonnet2026.04	27.6	22.7	17.4	68.4	30.5	29.9	63.6	27.6	64.8	78.4	34.5	27.8	32.6	35.1
Claude 3.7 Sonnet2026.05	27.6	22.7	17.4	68.4	30.5	29.9	63.6	27.6	64.8	78.4	34.5	27.8	32.6	40.5
LLaVA-Next2026.04	26.7	40	5	67	28.8	32.8	66.7	30	69	78	27	35	36	36
Qwen2-VL-7B2026.04	26.7	40	11	73	35.9	34.6	61.7	31.8	70	81	35	46.7	48	40.1
GeoLLaVA-8K2026.04	26.7	38	49	69	41.6	31.6	65	35	67	78	66	50	52	43.3
GeoLLaVA-8K2026.05	26.7	38	49	69	41.6	31.6	65	35	67	78	66	50	52	51.5
Qwen2-VL-7B2026.05	26.7	40	11	73	35.9	34.6	61.7	31.8	70	81	35	46.7	48	45.8
LLaVA-OneVision-7B2026.04	25	38	2	69.5	35.9	35.3	65	25.2	76	83	24	43.3	36	38.1
GPT-4o2026.04	25	32	15	66	9.5	11.3	11.7	24.6	73	73	35	20	25	23
InternVL3-78B2026.04	23.3	49	33	74	42.5	37.4	66.7	30	76	81	40	45	42	43.5
GPT-4o-mini2026.04	23.3	25	19	59.5	40.9	31	65	23.6	71	71	29	6.7	30	36.2
InternVL3-78B2026.05	23.3	49	33	74	42.5	37.4	66.7	30	76	81	40	45	42	49.2
InternLM-XComposer-2.52026.04	21.7	42	7	68	31.8	27.8	6.7	26	72	81	41	36.7	47	34.8
UHR-BAT2026.04	21.7	33	50	55.5	43.5	33.8	65	44.8	62	71	54	46.7	51	44
Qwen3-VL-8B2026.05	21.7	50	26	81.5	46.6	43.1	66.7	30.4	74	79	37	43.3	51	50
EarthDial2026.04	18.3	42	1	36	31.3	31	65	24.8	62	71	43	48.3	50	33.8
GeoChat2026.04	16.7	29	2	23	21.1	16.8	35	24.2	33	43	10	24	21	21.2
VHM2026.04	16.7	30	2	26	21.4	16.8	35	25.6	42	53	46	28.3	21	23.6
GeoChat2026.05	16.7	29	2	23	21.1	16.8	35	24.2	33	43	10	—	21	22.9