Learner Correctness Simulation on DBE-KT22
73.03AccuracyEdu-Theater
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Edu-TheaterBackbone LLM=GPT-4.1-mini2026.06 | 73.03 | 83.95 | 42.85 | |
| Edu-TheaterBackbone LLM=GPT-4o2026.06 | 72.93 | 83.72 | 43.73 | |
| Edu-TheaterBackbone LLM=GPT-3.5-turbo2026.06 | 71.72 | 83.21 | 43.63 | |
| Agent4EduBackbone LLM=GPT-4.1-mini2026.06 | 71.3 | 82.93 | 43.15 | |
| Agent4EduBackbone LLM=GPT-4o2026.06 | 70.82 | 82.13 | 42.73 | |
| Agent4EduBackbone LLM=GPT-3.5-turbo2026.06 | 70.3 | 81.82 | 42.57 | |
| EduAgentBackbone LLM=GPT-4.1-mini2026.06 | 69.95 | 81.22 | 42.6 | |
| EduAgentBackbone LLM=GPT-4o2026.06 | 69.82 | 80.82 | 42.4 | |
| Edu-TheaterBackbone LLM=Llama3-8b2026.06 | 69.77 | 80.88 | 42.33 | |
| EduAgentBackbone LLM=GPT-3.5-turbo2026.06 | 69.7 | 80.72 | 42.25 | |
| Edu-TheaterBackbone LLM=Llama2-7b2026.06 | 69.55 | 80.21 | 42.12 | |
| Agent4EduBackbone LLM=Llama3-8b2026.06 | 69.5 | 80.62 | 42.25 | |
| EERNN2026.06 | 69.32 | 79.66 | 42.15 | |
| Agent4EduBackbone LLM=Llama2-7b2026.06 | 69.3 | 79.92 | 42.13 | |
| DAISIM2026.06 | 69.03 | 81.05 | 34.92 | |
| SAKT2026.06 | 68.92 | 81.13 | 34.39 | |
| EduAgentBackbone LLM=Llama3-8b2026.06 | 68.45 | 79.22 | 41.4 | |
| EduAgentBackbone LLM=Llama2-7b2026.06 | 68.32 | 78.82 | 41.25 | |
| DKVMN2026.06 | 67.79 | 79.5 | 40.84 | |
| Llama3-8b2026.06 | 66.13 | 78.24 | 40.05 | |
| KES2026.06 | 65.41 | 74.92 | 35.17 | |
| GPT-3.5-turbo2026.06 | 65.05 | 75.21 | 35.77 | |
| GPT-4.1-mini2026.06 | 64.67 | 79.3 | 35.13 |