Retrieval-Augmented Generation on CovidQA
79.7FaithfulnessHyTE-Hbert
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HyTE-HbertRetrieval Context Window Size=5, Generator Model=Llama-3.1-8B-Instruct, Judge Model=Llama-3.1-8B-Instruct2026.02 | 79.7 | 97.4 | 75.5 | |
| GTERetrieval Context Window Size=5, Generator Model=Llama-3.1-8B-Instruct, Judge Model=Llama-3.1-8B-Instruct2026.02 | 69.5 | 84 | 53.8 | |
| GemmaRetrieval Context Window Size=5, Generator Model=Llama-3.1-8B-Instruct, Judge Model=Llama-3.1-8B-Instruct2026.02 | 68.5 | 76 | 49.7 | |
| ModernBert*Retrieval Context Window Size=5, Generator Model=Llama-3.1-8B-Instruct, Judge Model=Llama-3.1-8B-Instruct2026.02 | 65.6 | 89.5 | 53.78 | |
| KaLM-mini-v1Retrieval Context Window Size=5, Generator Model=Llama-3.1-8B-Instruct, Judge Model=Llama-3.1-8B-Instruct2026.02 | 65.6 | 78.7 | 52.8 |