Retrieval-Augmented Generation on Emanual
68.8FaithfulnessHyTE-Hbert
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HyTE-HbertRetrieval Context Window Size=5, Generator Model=Llama-3.1-8B-Instruct, Judge Model=Llama-3.1-8B-Instruct2026.02 | 68.8 | 94.3 | 89.9 | |
| ModernBert*Retrieval Context Window Size=5, Generator Model=Llama-3.1-8B-Instruct, Judge Model=Llama-3.1-8B-Instruct2026.02 | 56.7 | 71.5 | 63.9 | |
| KaLM-mini-v1Retrieval Context Window Size=5, Generator Model=Llama-3.1-8B-Instruct, Judge Model=Llama-3.1-8B-Instruct2026.02 | 56.5 | 77.6 | 61.6 | |
| GemmaRetrieval Context Window Size=5, Generator Model=Llama-3.1-8B-Instruct, Judge Model=Llama-3.1-8B-Instruct2026.02 | 55.5 | 88.4 | 68.7 | |
| GTERetrieval Context Window Size=5, Generator Model=Llama-3.1-8B-Instruct, Judge Model=Llama-3.1-8B-Instruct2026.02 | 54.6 | 60.8 | 68.6 |