List your company
ResearchFormerly WizWand

Question Answering on SQuAD entity-level knowledge conflict (test)

9.7MRFaithfulRAG
8.88414.39219.925.408Jun 10, 2025
Updated 8mo ago

Evaluation results

MethodLinks
FaithfulRAGBackbone LLM=mistral-7b-instruct, Category=Context-faithful Decoding2025.069.785.7
COIECDBackbone LLM=llama3.1-8b-instruct, Category=Context-faithful Decoding2025.0610.771.8
FaithfulRAGBackbone LLM=llama3.1-8b-instruct, Category=Context-faithful Decoding2025.0613.586.3
Opin(Instr)Backbone LLM=llama3.1-8b-instruct, Category=Context-faithful Prompting2025.0613.873.4
KREBackbone LLM=llama3.1-8b-instruct, Category=Context-faithful Decoding2025.0614.566.1
CADBackbone LLM=llama3.1-8b-instruct, Category=Context-faithful Decoding2025.0614.671.2
COIECDBackbone LLM=qwen2.5-7b-instruct, Category=Context-faithful Decoding2025.0615.570.8
FaithfulRAGBackbone LLM=qwen2.5-7b-instruct, Category=Context-faithful Decoding2025.0615.778.3
COIECDBackbone LLM=mistral-7b-instruct, Category=Context-faithful Decoding2025.0616.165.4
ATTRBackbone LLM=llama3.1-8b-instruct, Category=Context-faithful Prompting2025.0616.869.5
KREBackbone LLM=mistral-7b-instruct, Category=Context-faithful Decoding2025.0616.874.6
CADBackbone LLM=mistral-7b-instruct, Category=Context-faithful Decoding2025.061866.9
ChatQA-1.5Backbone LLM=Llama3.1-8B, Category=Specific RAG Models2025.0619.177
ATTRBackbone LLM=mistral-7b-instruct, Category=Context-faithful Prompting2025.0620.670.2
OriginBackbone LLM=llama3.1-8b-instruct, Category=With Full Context2025.0620.769.5
ChatQA-2.0Backbone LLM=Llama3.1-8B, Category=Specific RAG Models2025.0620.875.4
CADBackbone LLM=qwen2.5-7b-instruct, Category=Context-faithful Decoding2025.0621.773.4
ATTRBackbone LLM=qwen2.5-7b-instruct, Category=Context-faithful Prompting2025.0622.272.9
KREBackbone LLM=qwen2.5-7b-instruct, Category=Context-faithful Decoding2025.0622.773.7
Opin(Instr)Backbone LLM=mistral-7b-instruct, Category=Context-faithful Prompting2025.0622.969.3
OriginBackbone LLM=mistral-7b-instruct, Category=With Full Context2025.062567.2
Opin(Instr)Backbone LLM=qwen2.5-7b-instruct, Category=Context-faithful Prompting2025.0625.570.5
OriginBackbone LLM=qwen2.5-7b-instruct, Category=With Full Context2025.0627.668.3
Self-RAGBackbone LLM=Llama2-7B, Category=Specific RAG Models2025.0630.162