Question Answering on TriviaQA (EM, Performance Gain)
83.9Exact Match (EM)PatchRAG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PatchRAGStep=t, Generator=Llama-3 8B, Retriever=bge-m32026.04 | 83.9 | 7.1 | |
| RAFTStep=t, Generator=Llama-3 8B, Retriever=bge-m32026.04 | 80.5 | 4 | |
| Golden-onlyStep=t, Generator=Llama-3 8B, Retriever=bge-m32026.04 | 80 | 4.5 | |
| PatchRAGStep=< t, Generator=Llama-3 8B, Retriever=bge-m32026.04 | 76.8 | — | |
| RAFTStep=< t, Generator=Llama-3 8B, Retriever=bge-m32026.04 | 76.5 | — | |
| Golden-onlyStep=< t, Generator=Llama-3 8B, Retriever=bge-m32026.04 | 75.5 | — | |
| Standard RAGStep=-, Generator=Llama-3 8B, Retriever=bge-m32026.04 | 67.1 | — | |
| ChatQA-1.5Step=-, Generator=Llama-3 8B, Retriever=bge-m32026.04 | 61 | — | |
| Auto-RAGStep=-, Generator=Llama-3 8B, Retriever=bge-m32026.04 | 60.9 | — | |
| Self-RAGStep=-, Generator=Llama-3 8B, Retriever=bge-m32026.04 | 38.2 | — |