Student behavior and solution simulation on Student_100 1.0 (full)
89AccuracyGPT-4o
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-4oBehavior Prediction=Prototype Mapping, Solution Simulation=IO2025.05 | 89 | 3.9 | 3.61 | |
| GPT-4oBehavior Prediction=Prototype Mapping, Solution Simulation=CoT2025.05 | 89 | 3.9 | 3.65 | |
| GPT-4oBehavior Prediction=Prototype Mapping, Solution Simulation=Refine2025.05 | 89 | 3.9 | 3.83 | |
| Claude-3.5-SonnetBehavior Prediction=Prototype Mapping, Solution Simulation=IO2025.05 | 71 | 3.5 | 3.22 | |
| Claude-3.5-SonnetBehavior Prediction=Prototype Mapping, Solution Simulation=CoT2025.05 | 71 | 3.5 | 3.32 | |
| Claude-3.5-SonnetBehavior Prediction=Prototype Mapping, Solution Simulation=Refine2025.05 | 71 | 3.5 | 3.38 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Prototype Mapping, Solution Simulation=IO2025.05 | 67 | 3.35 | 2.75 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Prototype Mapping, Solution Simulation=CoT2025.05 | 67 | 3.35 | 2.73 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Prototype Mapping, Solution Simulation=Refine2025.05 | 67 | 3.35 | 2.89 | |
| Claude-3.5-SonnetBehavior Prediction=Similarity, Solution Simulation=IO2025.05 | 55 | 3.07 | 3.1 | |
| Claude-3.5-SonnetBehavior Prediction=Similarity, Solution Simulation=CoT2025.05 | 55 | 3.07 | 3.01 | |
| Claude-3.5-SonnetBehavior Prediction=Similarity, Solution Simulation=Refine2025.05 | 55 | 3.07 | 3.01 | |
| GPT-4oBehavior Prediction=Level+Random, Solution Simulation=IO2025.05 | 55 | 3.01 | 2.12 | |
| GPT-4oBehavior Prediction=Level+Random, Solution Simulation=CoT2025.05 | 55 | 3.01 | 2.65 | |
| GPT-4oBehavior Prediction=Level+Random, Solution Simulation=Refine2025.05 | 55 | 3.01 | 2.17 | |
| GPT-4oBehavior Prediction=Level+Similarity, Solution Simulation=IO2025.05 | 55 | 3.01 | 2.48 | |
| GPT-4oBehavior Prediction=Level+Similarity, Solution Simulation=CoT2025.05 | 55 | 3.01 | 2.73 | |
| GPT-4oBehavior Prediction=Level+Similarity, Solution Simulation=Refine2025.05 | 55 | 3.01 | 2.27 | |
| GPT-3.5Behavior Prediction=Prototype Mapping, Solution Simulation=IO2025.05 | 51 | 2.96 | 3.46 | |
| GPT-3.5Behavior Prediction=Prototype Mapping, Solution Simulation=CoT2025.05 | 51 | 2.96 | 3.58 | |
| GPT-3.5Behavior Prediction=Prototype Mapping, Solution Simulation=Refine2025.05 | 51 | 2.96 | 3.71 | |
| GPT-3.5Behavior Prediction=Level, Solution Simulation=IO2025.05 | 50 | 2.87 | 3.54 | |
| GPT-3.5Behavior Prediction=Level, Solution Simulation=CoT2025.05 | 50 | 2.87 | 3.58 | |
| GPT-3.5Behavior Prediction=Level, Solution Simulation=Refine2025.05 | 50 | 2.87 | 3.59 | |
| Claude-3.5-SonnetBehavior Prediction=Random, Solution Simulation=IO2025.05 | 49 | 2.87 | 2.93 | |
| Claude-3.5-SonnetBehavior Prediction=Random, Solution Simulation=CoT2025.05 | 49 | 2.87 | 2.77 | |
| Claude-3.5-SonnetBehavior Prediction=Random, Solution Simulation=Refine2025.05 | 49 | 2.87 | 2.77 | |
| GPT-3.5Behavior Prediction=Level+Similarity, Solution Simulation=IO2025.05 | 45 | 2.73 | 3.34 | |
| GPT-3.5Behavior Prediction=Level+Similarity, Solution Simulation=CoT2025.05 | 45 | 2.73 | 3.58 | |
| GPT-3.5Behavior Prediction=Level+Similarity, Solution Simulation=Refine2025.05 | 45 | 2.73 | 3.58 | |
| GPT-3.5Behavior Prediction=Level+Random, Solution Simulation=IO2025.05 | 42 | 2.66 | 3.47 | |
| GPT-3.5Behavior Prediction=Level+Random, Solution Simulation=CoT2025.05 | 42 | 2.66 | 3.53 | |
| GPT-3.5Behavior Prediction=Level+Random, Solution Simulation=Refine2025.05 | 42 | 2.66 | 3.59 | |
| GPT-4oBehavior Prediction=Similarity, Solution Simulation=IO2025.05 | 42 | 2.71 | 2.85 | |
| GPT-4oBehavior Prediction=Similarity, Solution Simulation=CoT2025.05 | 42 | 2.71 | 3.08 | |
| GPT-4oBehavior Prediction=Similarity, Solution Simulation=Refine2025.05 | 42 | 2.71 | 2.88 | |
| GPT-4oBehavior Prediction=Level, Solution Simulation=IO2025.05 | 40 | 2.45 | 2.42 | |
| GPT-4oBehavior Prediction=Level, Solution Simulation=CoT2025.05 | 40 | 2.45 | 2.85 | |
| GPT-4oBehavior Prediction=Level, Solution Simulation=Refine2025.05 | 40 | 2.45 | 1.83 | |
| GPT-3.5Behavior Prediction=Random, Solution Simulation=IO2025.05 | 37 | 2.47 | 3.47 | |
| GPT-3.5Behavior Prediction=Random, Solution Simulation=CoT2025.05 | 37 | 2.47 | 3.56 | |
| GPT-3.5Behavior Prediction=Random, Solution Simulation=Refine2025.05 | 37 | 2.47 | 3.61 | |
| GPT-4oBehavior Prediction=Random, Solution Simulation=IO2025.05 | 37 | 2.54 | 2.73 | |
| GPT-4oBehavior Prediction=Random, Solution Simulation=CoT2025.05 | 37 | 2.54 | 2.89 | |
| GPT-4oBehavior Prediction=Random, Solution Simulation=Refine2025.05 | 37 | 2.54 | 2.57 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Level+Similarity, Solution Simulation=IO2025.05 | 36 | 2.43 | 2.47 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Level+Similarity, Solution Simulation=CoT2025.05 | 36 | 2.43 | 2.31 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Level+Similarity, Solution Simulation=Refine2025.05 | 36 | 2.43 | 2.14 | |
| Claude-3.5-SonnetBehavior Prediction=Level+Similarity, Solution Simulation=IO2025.05 | 36 | 2.31 | 2.6 | |
| Claude-3.5-SonnetBehavior Prediction=Level+Similarity, Solution Simulation=CoT2025.05 | 36 | 2.31 | 2.56 | |
| Claude-3.5-SonnetBehavior Prediction=Level+Similarity, Solution Simulation=Refine2025.05 | 36 | 2.31 | 2.46 | |
| GPT-3.5Behavior Prediction=Similarity, Solution Simulation=IO2025.05 | 36 | 2.47 | 3.53 | |
| GPT-3.5Behavior Prediction=Similarity, Solution Simulation=CoT2025.05 | 36 | 2.47 | 3.51 | |
| GPT-3.5Behavior Prediction=Similarity, Solution Simulation=Refine2025.05 | 36 | 2.47 | 3.57 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Similarity, Solution Simulation=IO2025.05 | 35 | 2.44 | 2.22 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Similarity, Solution Simulation=CoT2025.05 | 35 | 2.44 | 2.23 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Similarity, Solution Simulation=Refine2025.05 | 35 | 2.44 | 2.16 | |
| Claude-3.5-SonnetBehavior Prediction=Level+Random, Solution Simulation=IO2025.05 | 35 | 2.25 | 2.41 | |
| Claude-3.5-SonnetBehavior Prediction=Level+Random, Solution Simulation=CoT2025.05 | 35 | 2.25 | 2.28 | |
| Claude-3.5-SonnetBehavior Prediction=Level+Random, Solution Simulation=Refine2025.05 | 35 | 2.25 | 2.27 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Level, Solution Simulation=IO2025.05 | 34 | 2.28 | 2.65 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Level, Solution Simulation=CoT2025.05 | 34 | 2.28 | 2.38 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Level, Solution Simulation=Refine2025.05 | 34 | 2.28 | 1.79 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Level+Random, Solution Simulation=IO2025.05 | 32 | 2.24 | 2.21 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Level+Random, Solution Simulation=CoT2025.05 | 32 | 2.24 | 2.02 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Level+Random, Solution Simulation=Refine2025.05 | 32 | 2.24 | 2.02 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Random, Solution Simulation=IO2025.05 | 29 | 2.26 | 2.01 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Random, Solution Simulation=CoT2025.05 | 29 | 2.26 | 2.02 | |
| LLaMA-3.3-70B-InstructBehavior Prediction=Random, Solution Simulation=Refine2025.05 | 29 | 2.26 | 2.03 | |
| Claude-3.5-SonnetBehavior Prediction=Level, Solution Simulation=IO2025.05 | 27 | 1.81 | 1.62 | |
| Claude-3.5-SonnetBehavior Prediction=Level, Solution Simulation=CoT2025.05 | 27 | 1.81 | 1.72 | |
| Claude-3.5-SonnetBehavior Prediction=Level, Solution Simulation=Refine2025.05 | 27 | 1.81 | 1.65 |