List your company
ResearchFormerly WizWand

Question Answering on MuSiQue entity-level knowledge conflict (test)

7.7Mean RankFaithfulRAG
7.25610.25313.2516.247Jun 10, 2025
Updated 8mo ago

Evaluation results

MethodLinks
FaithfulRAGBackbone LLM=mistral-7b-instruct, Category=Context-faithful Decoding2025.067.778.5
COIECDBackbone LLM=llama3.1-8b-instruct, Category=Context-faithful Decoding2025.069.270.5
COIECDBackbone LLM=qwen2.5-7b-instruct, Category=Context-faithful Decoding2025.069.869.7
COIECDBackbone LLM=mistral-7b-instruct, Category=Context-faithful Decoding2025.0610.366.8
Opin(Instr)Backbone LLM=llama3.1-8b-instruct, Category=Context-faithful Prompting2025.0611.370.3
CADBackbone LLM=mistral-7b-instruct, Category=Context-faithful Decoding2025.0611.863.6
FaithfulRAGBackbone LLM=llama3.1-8b-instruct, Category=Context-faithful Decoding2025.0611.879.9
CADBackbone LLM=qwen2.5-7b-instruct, Category=Context-faithful Decoding2025.0612.478.6
ATTRBackbone LLM=mistral-7b-instruct, Category=Context-faithful Prompting2025.0612.766.1
CADBackbone LLM=llama3.1-8b-instruct, Category=Context-faithful Decoding2025.0612.872.6
Opin(Instr)Backbone LLM=mistral-7b-instruct, Category=Context-faithful Prompting2025.0613.168.1
FaithfulRAGBackbone LLM=qwen2.5-7b-instruct, Category=Context-faithful Decoding2025.0613.878
ATTRBackbone LLM=qwen2.5-7b-instruct, Category=Context-faithful Prompting2025.061478.7
KREBackbone LLM=llama3.1-8b-instruct, Category=Context-faithful Decoding2025.061435.9
ATTRBackbone LLM=llama3.1-8b-instruct, Category=Context-faithful Prompting2025.0614.762.8
Opin(Instr)Backbone LLM=qwen2.5-7b-instruct, Category=Context-faithful Prompting2025.0615.376.9
ChatQA-2.0Backbone LLM=Llama3.1-8B, Category=Specific RAG Models2025.0615.577.2
OriginBackbone LLM=mistral-7b-instruct, Category=With Full Context2025.0615.967.6
KREBackbone LLM=mistral-7b-instruct, Category=Context-faithful Decoding2025.0616.350.6
OriginBackbone LLM=qwen2.5-7b-instruct, Category=With Full Context2025.0617.375.2
OriginBackbone LLM=llama3.1-8b-instruct, Category=With Full Context2025.0617.667.8
ChatQA-1.5Backbone LLM=Llama3.1-8B, Category=Specific RAG Models2025.0617.775
KREBackbone LLM=qwen2.5-7b-instruct, Category=Context-faithful Decoding2025.0618.670.7
Self-RAGBackbone LLM=Llama2-7B, Category=Specific RAG Models2025.0618.854.1