Topic Coverage on EduAgent (test)
98.85AAQG-SMS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| QG-SMSScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 98.85 | 98.62 | |
| MetricsScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 97.7 | 97.7 | |
| ReferenceScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 97 | 96.31 | |
| ChatEvalScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 96.77 | 95.85 | |
| VanillaScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 96.54 | 95.39 | |
| SwapScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 95.85 | 95.85 | |
| CoTScoring Protocol=Pairwise LLM-based, Base Model=GPT-4o2025.03 | 95.39 | 92.63 | |
| BERTScoreScoring Protocol=Individual Scoring2025.03 | 79.26 | — | |
| KDA_largeScoring Protocol=Individual Scoring2025.03 | 57.6 | — | |
| QSalienceScoring Protocol=Individual Scoring2025.03 | 54.84 | — |