Question Answering on MuSiQue (Accuracy (ACC))
79.9Accuracy (ACC)FaithfulRAG
Evaluation Results
| Method | Links | |
|---|---|---|
| FaithfulRAGBackbone LLM=llama3.1-8b-instruct2025.06 | 79.9 | |
| ATTRBackbone LLM=qwen2.5-7b-instruct2025.06 | 78.7 | |
| CADBackbone LLM=qwen2.5-7b-instruct2025.06 | 78.6 | |
| FaithfulRAGBackbone LLM=mistral-7b-instruct2025.06 | 78.5 | |
| FaithfulRAGBackbone LLM=qwen2.5-7b-instruct2025.06 | 78 | |
| ChatQA-2.0Backbone LLM=Llama3.1-8B2025.06 | 77.2 | |
| Opin(Instr)Backbone LLM=qwen2.5-7b-instruct2025.06 | 76.9 | |
| Origin model with full contextBackbone LLM=qwen2.5-7b-instruct2025.06 | 75.2 | |
| ChatQA-1.5Backbone LLM=Llama3.1-8B2025.06 | 75 | |
| CADBackbone LLM=llama3.1-8b-instruct2025.06 | 72.6 | |
| KREBackbone LLM=qwen2.5-7b-instruct2025.06 | 70.7 | |
| COIECDBackbone LLM=llama3.1-8b-instruct2025.06 | 70.5 | |
| Opin(Instr)Backbone LLM=llama3.1-8b-instruct2025.06 | 70.3 | |
| COIECDBackbone LLM=qwen2.5-7b-instruct2025.06 | 69.7 | |
| Opin(Instr)Backbone LLM=mistral-7b-instruct2025.06 | 68.1 | |
| Origin model with full contextBackbone LLM=llama3.1-8b-instruct2025.06 | 67.8 | |
| Origin model with full contextBackbone LLM=mistral-7b-instruct2025.06 | 67.6 | |
| COIECDBackbone LLM=mistral-7b-instruct2025.06 | 66.8 | |
| ATTRBackbone LLM=mistral-7b-instruct2025.06 | 66.1 | |
| CADBackbone LLM=mistral-7b-instruct2025.06 | 63.6 | |
| ATTRBackbone LLM=llama3.1-8b-instruct2025.06 | 62.8 | |
| Self-RAGBackbone LLM=Llama2-7B2025.06 | 54.1 | |
| KREBackbone LLM=mistral-7b-instruct2025.06 | 50.6 | |
| KREBackbone LLM=llama3.1-8b-instruct2025.06 | 35.9 | |
| L-RAGRetrieval Count (K)=82025.03 | 35.2 | |
| IRCoT2025.03 | 34.6 | |
| VanillaRAGRetrieval Count (K)=42025.03 | 30.5 | |
| VanillaRAGRetrieval Count (K)=82025.03 | 29.7 | |
| IterRetGen2025.03 | 29.7 | |
| L-RAGRetrieval Count (K)=42025.03 | 25.8 | |
| Origin model without contextBackbone LLM=qwen2.5-7b-instruct2025.06 | 19.6 | |
| SelfAsk2025.03 | 18 | |
| Origin model without contextBackbone LLM=mistral-7b-instruct2025.06 | 13.8 | |
| Origin model without contextBackbone LLM=llama3.1-8b-instruct2025.06 | 11.2 | |
| No RetrievalRetrieval=None2025.03 | 9.4 | |
| HyDE2025.03 | 7.6 |