Scientific Reasoning on HiPhO 2024–2025 1.0

25.2IPhO 2025 ScoreGemini-3-Pro

Evaluation Results

Method
Gemini-3-Pro2026.02	25.2	25.2	28.3	21	23.9	37.1	43.8	66.3	76.2	86	74.8	23.8	23.9	42.7	13	0	0
P1-235B-A22B2026.02	23.2	25.2	28	12.4	23.5	31.9	35.4	57.7	67	77.5	74.8	21.5	20.5	38.4	12	1	0
Gemini-2.5-Pro2026.02	22.7	25.9	27.9	14.9	21.8	32.3	35.9	60.3	64.1	69.5	70.2	22.8	22	37.7	12	1	0
GPT-5.22026.02	22.3	25.5	28.4	15.7	23.9	35.8	37.1	59.8	82.5	67.6	82.3	23.4	23.5	40.6	12	1	0
GPT-52026.02	22.3	20.2	27	10.3	21.7	32.9	32.8	55.9	69.8	69.4	79	22.4	22.4	37.4	11	2	0
P1-VL-235B-A22B2026.02	22.1	25.8	27.1	13.7	22.9	31.8	32.6	66.5	83.3	76	84.8	23.1	21.8	40.9	12	1	0
P1-235B-A22B2026.02	21.2	24.7	27.4	10.8	23	31.8	28.4	54.7	56.7	74.7	72.9	20.9	19.4	35.9	12	1	0
P1-VL-235B-A22B2026.02	21	25.3	26.9	10.7	21.5	32.5	31.9	61.7	79.8	73.3	82	22.5	21.9	39.3	12	1	0
GPT-OSS-120B2026.02	20.5	22.1	25.8	12.8	23	32.4	32.4	48.8	52.4	54.7	56.1	20.5	19.2	32.4	12	1	0
DeepSeek-V3.22026.02	20.2	24.9	26.1	6.7	18.9	33.3	29.7	57.3	64.9	78.6	78	21.5	19.9	36.9	11	1	1
Gemini-2.5-Flash2026.02	20.2	23.9	27.4	13.2	21.9	29	29.3	44.6	54.9	60.5	55.9	17.8	19.1	32.1	12	1	0
Qwen3-VL-235B-A22B2026.02	19.8	23.4	25.4	10.8	19	29.2	25.9	48.3	54	64.3	79.9	21.4	19.9	33.9	10	3	0
Kimi-K22026.02	19.1	22.8	22.4	5.2	20.9	26	20.6	52.5	51.3	47.3	64.8	20.6	19.7	30.2	6	6	0
Claude-4-Sonnet2026.02	19	22	24.8	9.7	20.5	28.1	25.6	43.1	39.3	57.4	61.8	19.2	20.1	30	8	4	1
Grok-42026.02	18.7	23.5	25	11.5	20.5	25.8	29.3	45	75.4	72.1	78.6	19.8	19.8	35.8	10	3	0
P1-30B-A3B2026.02	18.5	22.3	25.4	7.4	18.8	29.2	24	47	51.4	69.5	69.1	19.6	20	32.5	8	4	1
DeepSeek-R12026.02	18.5	24.6	25.4	10.8	21.4	26.3	20.5	42.2	47.4	65.4	72.5	18.3	18.5	31.7	8	5	0
P1-VL-30B-A3B2026.02	17.9	22.5	24.6	10.6	19	30.2	24.6	50.8	58.6	79.1	75.5	20.8	20.3	35	9	4	0
Qwen3-235B-A22B-Thinking-25072026.02	17.1	23	26.2	10.9	20.4	33.6	28.1	44.7	51.8	69.1	72.9	18.5	18.9	33.5	10	3	0
GPT-OSS-120B2026.02	16.9	21.4	22.8	9.1	19.9	26	25.8	37.4	41.8	57.1	59.7	17.8	17.6	28.7	5	7	1
Kimi-K22026.02	16.5	19.8	24.2	11	16.9	26.5	26.2	35.9	41.8	65.9	58.9	16	18.2	29.1	5	8	0
o4-mini2026.02	16	23.7	22.9	12	20.1	27.4	29.8	41.4	50.9	69.1	67.3	18.6	18.8	32.2	6	7	0
Intern-S12026.02	15.9	14.2	21.7	9	16.6	23	20.5	41.1	50.3	60.4	57.4	18.4	19.5	28.3	4	8	1
o32026.02	15.7	23.7	25.9	11.4	21.6	34.1	33.5	47.3	55.9	71.4	75.6	22	20.6	35.3	11	2	0
Qwen3-VL-30B-A3B2026.02	15.7	19.3	25.3	11.7	20.2	29.7	28.3	41.6	45.9	57.6	51.4	18.9	20.7	29.7	8	5	0
Qwen3-32B2026.02	15.7	19.3	23.9	9.8	21.2	28.9	24.1	36.6	41.8	67	59.2	18.9	16.6	29.5	7	6	0
Claude-4-Sonnet2026.02	15.7	19.2	22.8	9.5	16.5	27.5	21.3	40.4	43.3	46.5	48.5	16.8	16.5	26.5	2	10	1
Qwen3-30B-A3B-Thinking-25072026.02	15.6	19.7	23.5	7.4	16.4	28.6	22.2	40.5	43.8	67.7	66.5	18.3	18	29.9	6	6	1
o4-mini2026.02	15.4	22.9	22.8	10.1	20.9	26.9	27.3	39.4	47.1	64.2	62.5	18.6	18.5	30.5	7	6	0
Mistral-Medium-32026.02	14.2	14.1	19.9	8.5	12.2	20.4	19.6	30.8	28.6	32.9	36.1	13.9	14.1	20.4	1	8	4
DeepSeek-V32026.02	13.6	16.4	22.1	7.1	17.2	21.1	17.3	37.2	35	48.4	46.5	14.1	15.6	24	1	9	3
InternVL3-78B-Instruct2026.02	12.9	12.5	17.7	7.5	15.2	22.3	22.5	26.2	27.4	21.1	27.1	12	13	18.3	0	8	5
GLM-4.5V2026.02	11.9	4.4	16.2	8.7	14.1	19.5	14	18.5	16	47.8	39	13	13.8	18.2	0	4	9
Qwen3-8B2026.02	10.6	12.7	11.5	7.1	11.9	20.1	17.3	26.3	22.3	21.8	22.8	10.8	10	15.8	0	2	10
Qwen2.5-VL-72B-Instruct2026.02	10.6	7.2	13.6	6.1	8.1	13.3	11.4	26.8	18.2	24	28.5	13.5	9.8	14.7	0	2	7
GPT-4o2026.02	10.2	9.4	15.1	6.8	9.2	16.4	11.7	27.8	22.8	28.2	26.5	15	10.9	16.2	1	1	10
Qwen2.5-VL-32B-Instruct2026.02	9.9	8.2	16.5	6.9	10	15.3	14.4	22.5	22.4	28.1	29.9	7.6	4.6	15.1	0	1	10
LLaMA4-Scout-17B2026.02	9.7	9.5	13.1	5.4	10.4	22.8	12.8	26.6	24.1	35.4	34.5	8.1	6.4	16.8	0	2	7
InternVL3-38B-Instruct2026.02	8.9	7.8	12.3	6.1	8.3	14	10.6	24.1	20.4	27.5	24.8	8.2	6.8	13.8	0	0	7
InternVL3-9B-Instruct2026.02	4.7	3.7	7.2	4.2	4.1	9.4	6	12.4	11	11.6	16.3	6.4	6.2	7.9	0	0	2
Qwen2.5-VL-7B-Instruct2026.02	3.5	2.5	5.7	4.4	3.6	7.3	5.5	14.7	7.6	9.8	11.5	4.4	3.5	6.5	0	0	1
Phi-4-multimodal2026.02	2	1.6	4.2	3.6	3.6	5	4.5	8.3	9	10	10.1	4.4	5	5.5	0	0	0
DeepSeek-VL22026.02	1.8	0.5	2.5	3.4	3.4	5	3.2	5.6	4.8	7.3	6.4	5	3.9	4	0	0	0