Pedagogical Tutoring on SHAPE benchmark leaderboard · SOTA2 Research

Pedagogical Tutoring on SHAPE

100Safety ScoreGemini 2.5 Flash-Lite

Evaluation Results

Method	Links
Gemini 2.5 Flash-Lite2026.04		100	17.88	83.37
Qwen3-80B2026.04		99.29	1.12	70.33
Gemini 2.5 Pro2026.04		99.05	98.32	80.58
Claude Haiku 4.52026.04		97.86	38.55	84.47
GPT-5 mini2026.04		94.77	100	94.49
Claude Opus 4.52026.04		93.82	99.44	78.99
Gemini 2.5 Flash2026.04		93.59	100	77.66
GPT-5 nano2026.04		93.35	84.92	86.51
GPT-5 mini2026.04		93.11	100	95.15
Claude Haiku 4.52026.04		91.69	44.13	85.49
GPT-52026.04		91.21	100	96.35
GPT-52026.04		90.26	100	96.05
Qwen3-8B2026.04		90.26	46.93	73.95
GPT-5 nano2026.04		90.02	78.77	85.75
Educhat-32B2026.04		89.12	20.75	56.49
Gemini 2.5 Flash2026.04		81.71	100	85.47
Gemini 2.5 Flash-Lite2026.04		78.62	86.03	87.31
GPT-52026.04		74.35	99.44	88.5
Claude Haiku 4.52026.04		66.27	74.86	46.24
Qwen3-32B2026.04		63.42	58.1	68.91
GPT-5 mini2026.04		36.1	100	93.42
Claude Opus 4.52026.04		31.59	100	87.22
GPT-5 nano2026.04		31.12	89.39	86.26
Educhat-8B2026.04		27.89	71.7	31.71
Claude Opus 4.52026.04		24.23	100	82.35
Educhat-8B2026.04		21.77	84.91	50
Gemini 2.5 Pro2026.04		16.86	98.88	60.56
Educhat-8B2026.04		12.93	90.57	78.95
Gemini 2.5 Flash-Lite2026.04		12.35	100	86.54
Educhat-32B2026.04		6.8	92.45	50
Gemini 2.5 Flash2026.04		6.41	98.88	70.37
Educhat-32B2026.04		6.12	98.11	88.89
SocraticLM-8B2026.04		6.12	83.02	22.22
SocraticLM-8B2026.04		4.76	98.11	85.71
Gemini 2.5 Pro2026.04		4.28	99.44	27.78
SocraticLM-8B2026.04		2.04	98.11	66.67
Qwen3-32B2026.04		1.9	98.88	37.5
Qwen3-32B2026.04		1.66	97.77	0
Qwen3-8B2026.04		0.48	100	0
Qwen3-80B2026.04		0.24	100	0
Qwen3-80B2026.04		0	100	0
Qwen3-8B2026.04		0	99.44	0