Pedagogical Tutoring on SHAPE
100Safety ScoreGemini 2.5 Flash-Lite
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini 2.5 Flash-LiteEvaluation Setting=Default2026.04 | 100 | 17.88 | 83.37 | |
| Qwen3-80BEvaluation Setting=Default2026.04 | 99.29 | 1.12 | 70.33 | |
| Gemini 2.5 ProEvaluation Setting=Default2026.04 | 99.05 | 98.32 | 80.58 | |
| Claude Haiku 4.5Evaluation Setting=Default2026.04 | 97.86 | 38.55 | 84.47 | |
| GPT-5 miniEvaluation Setting=Default2026.04 | 94.77 | 100 | 94.49 | |
| Claude Opus 4.5Evaluation Setting=Default2026.04 | 93.82 | 99.44 | 78.99 | |
| Gemini 2.5 FlashEvaluation Setting=Default2026.04 | 93.59 | 100 | 77.66 | |
| GPT-5 nanoEvaluation Setting=Default2026.04 | 93.35 | 84.92 | 86.51 | |
| GPT-5 miniEvaluation Setting=Refusal Supp.2026.04 | 93.11 | 100 | 95.15 | |
| Claude Haiku 4.5Evaluation Setting=Refusal Supp.2026.04 | 91.69 | 44.13 | 85.49 | |
| GPT-5Evaluation Setting=Default2026.04 | 91.21 | 100 | 96.35 | |
| GPT-5Evaluation Setting=Refusal Supp.2026.04 | 90.26 | 100 | 96.05 | |
| Qwen3-8BEvaluation Setting=Default2026.04 | 90.26 | 46.93 | 73.95 | |
| GPT-5 nanoEvaluation Setting=Refusal Supp.2026.04 | 90.02 | 78.77 | 85.75 | |
| Educhat-32BEvaluation Setting=Default2026.04 | 89.12 | 20.75 | 56.49 | |
| Gemini 2.5 FlashEvaluation Setting=Refusal Supp.2026.04 | 81.71 | 100 | 85.47 | |
| Gemini 2.5 Flash-LiteEvaluation Setting=Refusal Supp.2026.04 | 78.62 | 86.03 | 87.31 | |
| GPT-5Evaluation Setting=Role Play2026.04 | 74.35 | 99.44 | 88.5 | |
| Claude Haiku 4.5Evaluation Setting=Role Play2026.04 | 66.27 | 74.86 | 46.24 | |
| Qwen3-32BEvaluation Setting=Default2026.04 | 63.42 | 58.1 | 68.91 | |
| GPT-5 miniEvaluation Setting=Role Play2026.04 | 36.1 | 100 | 93.42 | |
| Claude Opus 4.5Evaluation Setting=Refusal Supp.2026.04 | 31.59 | 100 | 87.22 | |
| GPT-5 nanoEvaluation Setting=Role Play2026.04 | 31.12 | 89.39 | 86.26 | |
| Educhat-8BEvaluation Setting=Role Play2026.04 | 27.89 | 71.7 | 31.71 | |
| Claude Opus 4.5Evaluation Setting=Role Play2026.04 | 24.23 | 100 | 82.35 | |
| Educhat-8BEvaluation Setting=Default2026.04 | 21.77 | 84.91 | 50 | |
| Gemini 2.5 ProEvaluation Setting=Refusal Supp.2026.04 | 16.86 | 98.88 | 60.56 | |
| Educhat-8BEvaluation Setting=Refusal Supp.2026.04 | 12.93 | 90.57 | 78.95 | |
| Gemini 2.5 Flash-LiteEvaluation Setting=Role Play2026.04 | 12.35 | 100 | 86.54 | |
| Educhat-32BEvaluation Setting=Refusal Supp.2026.04 | 6.8 | 92.45 | 50 | |
| Gemini 2.5 FlashEvaluation Setting=Role Play2026.04 | 6.41 | 98.88 | 70.37 | |
| Educhat-32BEvaluation Setting=Role Play2026.04 | 6.12 | 98.11 | 88.89 | |
| SocraticLM-8BEvaluation Setting=Refusal Supp.2026.04 | 6.12 | 83.02 | 22.22 | |
| SocraticLM-8BEvaluation Setting=Default2026.04 | 4.76 | 98.11 | 85.71 | |
| Gemini 2.5 ProEvaluation Setting=Role Play2026.04 | 4.28 | 99.44 | 27.78 | |
| SocraticLM-8BEvaluation Setting=Role Play2026.04 | 2.04 | 98.11 | 66.67 | |
| Qwen3-32BEvaluation Setting=Role Play2026.04 | 1.9 | 98.88 | 37.5 | |
| Qwen3-32BEvaluation Setting=Refusal Supp.2026.04 | 1.66 | 97.77 | 0 | |
| Qwen3-8BEvaluation Setting=Role Play2026.04 | 0.48 | 100 | 0 | |
| Qwen3-80BEvaluation Setting=Role Play2026.04 | 0.24 | 100 | 0 | |
| Qwen3-80BEvaluation Setting=Refusal Supp.2026.04 | 0 | 100 | 0 | |
| Qwen3-8BEvaluation Setting=Refusal Supp.2026.04 | 0 | 99.44 | 0 |