List your company
ResearchFormerly WizWand

Question Answering on SQuAD (Accuracy (ACC))

86.3Accuracy (ACC)FaithfulRAG
8.09228.39648.769.004Jun 10, 2025
Updated 8mo ago

Evaluation results

MethodLinks
FaithfulRAGBackbone LLM=llama3.1-8b-instruct2025.0686.3
FaithfulRAGBackbone LLM=mistral-7b-instruct2025.0685.7
FaithfulRAGBackbone LLM=qwen2.5-7b-instruct2025.0678.3
ChatQA-1.5Backbone LLM=Llama3.1-8B2025.0677
ChatQA-2.0Backbone LLM=Llama3.1-8B2025.0675.4
KREBackbone LLM=mistral-7b-instruct2025.0674.6
KREBackbone LLM=qwen2.5-7b-instruct2025.0673.7
Opin(Instr)Backbone LLM=llama3.1-8b-instruct2025.0673.4
CADBackbone LLM=qwen2.5-7b-instruct2025.0673.4
ATTRBackbone LLM=qwen2.5-7b-instruct2025.0672.9
COIECDBackbone LLM=llama3.1-8b-instruct2025.0671.8
CADBackbone LLM=llama3.1-8b-instruct2025.0671.2
COIECDBackbone LLM=qwen2.5-7b-instruct2025.0670.8
Opin(Instr)Backbone LLM=qwen2.5-7b-instruct2025.0670.5
ATTRBackbone LLM=mistral-7b-instruct2025.0670.2
Origin model with full contextBackbone LLM=llama3.1-8b-instruct2025.0669.5
ATTRBackbone LLM=llama3.1-8b-instruct2025.0669.5
Opin(Instr)Backbone LLM=mistral-7b-instruct2025.0669.3
Origin model with full contextBackbone LLM=qwen2.5-7b-instruct2025.0668.3
Origin model with full contextBackbone LLM=mistral-7b-instruct2025.0667.2
CADBackbone LLM=mistral-7b-instruct2025.0666.9
KREBackbone LLM=llama3.1-8b-instruct2025.0666.1
COIECDBackbone LLM=mistral-7b-instruct2025.0665.4
Self-RAGBackbone LLM=Llama2-7B2025.0662
Origin model without contextBackbone LLM=mistral-7b-instruct2025.0611.5
Origin model without contextBackbone LLM=llama3.1-8b-instruct2025.0611.2
Origin model without contextBackbone LLM=qwen2.5-7b-instruct2025.0611.1