Discrimination on EduAgent (test)
66.39AccuracyQG-SMS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| QG-SMSScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 66.39 | 55.74 | |
| BERTScoreScoring Protocol=Individual Scoring2025.03 | 65.57 | — | |
| MetricsScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 65.57 | 50.82 | |
| SwapScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 64.75 | 45.9 | |
| VanillaScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 63.11 | 49.18 | |
| ReferenceScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 62.3 | 45.9 | |
| KDA_largeScoring Protocol=Individual Scoring2025.03 | 60.66 | — | |
| CoTScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 59.84 | 32.79 | |
| ChatEvalScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 54.92 | 42.56 | |
| QSalienceScoring Protocol=Individual Scoring2025.03 | 52.46 | — |