Academic Regulation Advising dataset
98.55AccuracyRAG
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| RAGProvider=Mistral AI, Threshold=0.62025.10 | 98.55 | 99.33 | 98.57 | 98.95 | — | |
| CatRAGProvider=OpenAI, Threshold=0.62025.10 | 98.48 | 99.33 | 98.46 | 98.89 | — | |
| CatRAGProvider=Mistral AI, Threshold=0.62025.10 | 98.25 | 99.11 | 98.35 | 98.73 | — | |
| RAGProvider=OpenAI, Threshold=0.62025.10 | 98.17 | 98.78 | 98.56 | 98.67 | — | |
| CatRAGProvider=Mistral AI, Threshold=0.72025.10 | 95.66 | 95.33 | 98.28 | 96.79 | 1 | |
| CatRAGProvider=OpenAI, Threshold=0.72025.10 | 95.58 | 95.11 | 98.39 | 96.72 | 2 | |
| RAGProvider=Mistral AI, Threshold=0.72025.10 | 93.99 | 92.67 | 98.47 | 95.48 | 1 | |
| RAGProvider=OpenAI, Threshold=0.72025.10 | 93.75 | 92.32 | 98.46 | 95.29 | 2 | |
| CatRAGProvider=OpenAI, Threshold=0.82025.10 | 88.58 | 84.87 | 98.2 | 91.05 | — | |
| RAGProvider=OpenAI, Threshold=0.82025.10 | 86.44 | 81.65 | 98.26 | 89.19 | — | |
| CatRAGProvider=Mistral AI, Threshold=0.82025.10 | 85 | 79.76 | 97.95 | 87.92 | — | |
| RAGProvider=Mistral AI, Threshold=0.82025.10 | 82.86 | 76.42 | 98.14 | 85.93 | — |