List your company

Socratic Conversation Generation on Socratic Debugging of Student Code 227 samples

98.7Valid Conversions RateGPT-5
67.08475.29283.591.708Nov 1, 2025

Evaluation results

MethodLinks
GPT-5Effort level=low-effort, Reasoning=true2025.1198.799.4
GPT-5-miniEffort level=medium-effort, Reasoning=true2025.1195.998.7
GPT-5Effort level=medium-effort, Reasoning=true2025.1194.898.5
GPT-5Effort level=minimal-effort, Reasoning=true2025.1194.398.6
Claude Sonnet-4.5Reasoning=true2025.1192.597.9
GPT-5-miniEffort level=low-effort, Reasoning=true2025.1192.198
Claude Sonnet-4.5Reasoning=false2025.118997.4
Gemini 2.5-flashReasoning=false2025.1186.197.4
Gemini 2.5-flashReasoning=true2025.1185.896.7
GPT-5-miniEffort level=minimal-effort, Reasoning=true2025.118596.9
Claude Haiku-4.5Reasoning=true2025.1181.595.7
Gemini 2.5-proReasoning=true2025.1178.795.5
Gemini 2.5-proReasoning=false2025.1178.394.9
Claude Haiku-4.5Reasoning=false2025.1168.393.2