Solution Simulation on Student_15 1.0 (test)
27.37ROUGE-LGPT-3.5
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-3.5Behavior Prediction Strategy=Prototype Mapping, Solution Simulation Strategy=Refine2025.05 | 27.37 | 5.63 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Prototype Mapping, Solution Simulation Strategy=Refine2025.05 | 26.63 | 4.91 | |
| GPT-3.5Behavior Prediction Strategy=Level+Similarity, Solution Simulation Strategy=Refine2025.05 | 26.61 | 5.38 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Level+Similarity, Solution Simulation Strategy=CoT2025.05 | 26.55 | 4.11 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Level+Similarity, Solution Simulation Strategy=Refine2025.05 | 26.37 | 4.77 | |
| GPT-3.5Behavior Prediction Strategy=Similarity, Solution Simulation Strategy=Refine2025.05 | 26.34 | 5.6 | |
| GPT-3.5Behavior Prediction Strategy=Random, Solution Simulation Strategy=Refine2025.05 | 25.76 | 4.37 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Similarity, Solution Simulation Strategy=CoT2025.05 | 25.72 | 2.96 | |
| GPT-3.5Behavior Prediction Strategy=Similarity, Solution Simulation Strategy=IO2025.05 | 25.59 | 4.78 | |
| GPT-3.5Behavior Prediction Strategy=Level+Random, Solution Simulation Strategy=Refine2025.05 | 25.41 | 4.53 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Similarity, Solution Simulation Strategy=Refine2025.05 | 24.61 | 4.53 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Prototype Mapping, Solution Simulation Strategy=IO2025.05 | 24.5 | 4.25 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Prototype Mapping, Solution Simulation Strategy=CoT2025.05 | 24.32 | 3.17 | |
| GPT-3.5Behavior Prediction Strategy=Level, Solution Simulation Strategy=Refine2025.05 | 24.13 | 4.21 | |
| GPT-3.5Behavior Prediction Strategy=Prototype Mapping, Solution Simulation Strategy=IO2025.05 | 23.88 | 4.19 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Random, Solution Simulation Strategy=Refine2025.05 | 23.67 | 3.76 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Level+Similarity, Solution Simulation Strategy=IO2025.05 | 23.59 | 3.27 | |
| GPT-3.5Behavior Prediction Strategy=Random, Solution Simulation Strategy=IO2025.05 | 23.59 | 3.28 | |
| GPT-3.5Behavior Prediction Strategy=Level+Similarity, Solution Simulation Strategy=IO2025.05 | 22.85 | 4.52 | |
| GPT-3.5Behavior Prediction Strategy=Level+Random, Solution Simulation Strategy=IO2025.05 | 22.68 | 3 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Level, Solution Simulation Strategy=Refine2025.05 | 22.67 | 3.07 | |
| GPT-4oBehavior Prediction Strategy=Prototype Mapping, Solution Simulation Strategy=Refine2025.05 | 22.28 | 4.59 | |
| GPT-4oBehavior Prediction Strategy=Similarity, Solution Simulation Strategy=Refine2025.05 | 22.12 | 3.57 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Similarity, Solution Simulation Strategy=IO2025.05 | 21.8 | 3.75 | |
| GPT-4oBehavior Prediction Strategy=Prototype Mapping, Solution Simulation Strategy=IO2025.05 | 21.64 | 2.55 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Level+Random, Solution Simulation Strategy=Refine2025.05 | 21.51 | 3.56 | |
| GPT-3.5Behavior Prediction Strategy=Level+Similarity, Solution Simulation Strategy=CoT2025.05 | 21.38 | 2.6 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Prototype Mapping, Solution Simulation Strategy=Refine2025.05 | 21.37 | 2.91 | |
| GPT-4oBehavior Prediction Strategy=Level+Similarity, Solution Simulation Strategy=Refine2025.05 | 21.33 | 3.15 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Similarity, Solution Simulation Strategy=Refine2025.05 | 21.32 | 2.77 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Random, Solution Simulation Strategy=IO2025.05 | 21.24 | 2.47 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Level, Solution Simulation Strategy=CoT2025.05 | 20.99 | 1.88 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Random, Solution Simulation Strategy=CoT2025.05 | 20.96 | 2.39 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Level+Similarity, Solution Simulation Strategy=Refine2025.05 | 20.94 | 2.86 | |
| GPT-3.5Behavior Prediction Strategy=Prototype Mapping, Solution Simulation Strategy=CoT2025.05 | 20.91 | 2.65 | |
| GPT-4oBehavior Prediction Strategy=Similarity, Solution Simulation Strategy=IO2025.05 | 20.64 | 2.48 | |
| GPT-4oBehavior Prediction Strategy=Level, Solution Simulation Strategy=Refine2025.05 | 20.45 | 1.8 | |
| GPT-3.5Behavior Prediction Strategy=Level, Solution Simulation Strategy=IO2025.05 | 20.44 | 2.3 | |
| GPT-4oBehavior Prediction Strategy=Prototype Mapping, Solution Simulation Strategy=CoT2025.05 | 20.35 | 3.26 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Level, Solution Simulation Strategy=Refine2025.05 | 20.31 | 1.41 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Level+Random, Solution Simulation Strategy=IO2025.05 | 20.24 | 2.41 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Level+Random, Solution Simulation Strategy=CoT2025.05 | 20.06 | 2.49 | |
| GPT-4oBehavior Prediction Strategy=Similarity, Solution Simulation Strategy=CoT2025.05 | 20.06 | 2.37 | |
| GPT-4oBehavior Prediction Strategy=Level+Random, Solution Simulation Strategy=Refine2025.05 | 20.01 | 2.46 | |
| GPT-3.5Behavior Prediction Strategy=Random, Solution Simulation Strategy=CoT2025.05 | 19.94 | 1.8 | |
| GPT-4oBehavior Prediction Strategy=Level+Similarity, Solution Simulation Strategy=IO2025.05 | 19.83 | 2.8 | |
| GPT-3.5Behavior Prediction Strategy=Level+Random, Solution Simulation Strategy=CoT2025.05 | 19.51 | 2.56 | |
| GPT-4oBehavior Prediction Strategy=Level+Random, Solution Simulation Strategy=IO2025.05 | 19.29 | 2.35 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Level+Random, Solution Simulation Strategy=Refine2025.05 | 19.28 | 2.31 | |
| GPT-3.5Behavior Prediction Strategy=Level, Solution Simulation Strategy=CoT2025.05 | 19.23 | 1.75 | |
| GPT-3.5Behavior Prediction Strategy=Similarity, Solution Simulation Strategy=CoT2025.05 | 19.08 | 2.51 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Random, Solution Simulation Strategy=Refine2025.05 | 18.92 | 2.18 | |
| Claude-3.5-SonnetBehavior Prediction Strategy=Level, Solution Simulation Strategy=IO2025.05 | 18.58 | 1.37 | |
| GPT-4oBehavior Prediction Strategy=Random, Solution Simulation Strategy=Refine2025.05 | 18.32 | 2.44 | |
| GPT-4oBehavior Prediction Strategy=Random, Solution Simulation Strategy=IO2025.05 | 18.12 | 1.77 | |
| GPT-4oBehavior Prediction Strategy=Level, Solution Simulation Strategy=IO2025.05 | 17.61 | 1.29 | |
| GPT-4oBehavior Prediction Strategy=Level+Similarity, Solution Simulation Strategy=CoT2025.05 | 17.34 | 2.19 | |
| GPT-4oBehavior Prediction Strategy=Level, Solution Simulation Strategy=CoT2025.05 | 16.79 | 1.12 | |
| GPT-4oBehavior Prediction Strategy=Random, Solution Simulation Strategy=CoT2025.05 | 16.28 | 1.8 | |
| GPT-4oBehavior Prediction Strategy=Level+Random, Solution Simulation Strategy=CoT2025.05 | 16.19 | 1.54 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Prototype Mapping, Solution Simulation Strategy=IO2025.05 | 15.76 | 0.93 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Level+Similarity, Solution Simulation Strategy=IO2025.05 | 13.95 | 0.79 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Prototype Mapping, Solution Simulation Strategy=CoT2025.05 | 13.59 | 0.86 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Level+Random, Solution Simulation Strategy=CoT2025.05 | 13.11 | 0.64 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Similarity, Solution Simulation Strategy=IO2025.05 | 12.74 | 0.69 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Random, Solution Simulation Strategy=IO2025.05 | 12.63 | 0.59 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Level, Solution Simulation Strategy=IO2025.05 | 12.55 | 0.49 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Similarity, Solution Simulation Strategy=CoT2025.05 | 12.49 | 0.78 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Level+Random, Solution Simulation Strategy=IO2025.05 | 12.49 | 0.69 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Level, Solution Simulation Strategy=CoT2025.05 | 12.39 | 0.52 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Random, Solution Simulation Strategy=CoT2025.05 | 12.23 | 0.63 | |
| LLaMA-3.3-70B-InstructBehavior Prediction Strategy=Level+Similarity, Solution Simulation Strategy=CoT2025.05 | 11.88 | 0.82 |