Difficulty on EduAgent (test)
68.95Accuracy (AA)ChatEval
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ChatEvalScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 68.95 | 51.61 | |
| QG-SMSScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 68.55 | 65.32 | |
| ReferenceScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 66.53 | 51.61 | |
| SwapScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 66.53 | 54.84 | |
| MetricsScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 65.32 | 53.22 | |
| VanillaScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 63.71 | 50.8 | |
| CoTScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 61.69 | 32.26 | |
| KDA_largeScoring Protocol=Individual Scoring2025.03 | 60.48 | — | |
| QSalienceScoring Protocol=Individual Scoring2025.03 | 54.03 | — | |
| BERTScoreScoring Protocol=Individual Scoring2025.03 | 51.61 | — |