Course Recommendation on Course Query Dataset Large-scale (152 queries)
96.8MRRRAGEAR
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| RAGEARevaluation_protocol=LLM-based, relevance_rubric=0 to 5, queries=1522026.05 | 96.8 | 95.4 | 81.6 | 73 | 82.8 | 79 | 79.5 | 28 | 38.2 | |
| TRANSCRIPT NORMALIZED SUMPevaluation_protocol=LLM-based, relevance_rubric=0 to 5, queries=152, aggregation=normalized SumP aggregation2026.05 | 95.5 | 92.8 | 80.5 | 72.2 | 79.5 | 77 | 77.6 | 26.7 | 36.6 | |
| METADATAevaluation_protocol=LLM-based, relevance_rubric=0 to 5, queries=1522026.05 | 92.3 | 86.2 | 75 | 67.6 | 77.3 | 74.4 | 75.5 | 23.9 | 32.6 |