List your company
ResearchFormerly WizWand

Multi-hop Question Answering on MuSiQue Wiki-18

24.4Exact Match (EM)Esearch-base
-0.046.30512.6518.995Oct 1, 2025
Updated 6mo ago

Evaluation results

MethodLinks
Esearch-baseModel Backbone=Qwen2.5-7b, Search Engine=Wiki-18, Model Variant=Base2025.1024.437.1
Esearch-instructModel Backbone=Qwen2.5-7b, Search Engine=Wiki-18, Model Variant=Instruct2025.1024.135.8
Esearch-baseModel Backbone=Qwen2.5-3b, Search Engine=Wiki-18, Model Variant=Base2025.1023.634.5
Esearch-instructModel Backbone=Qwen2.5-3b, Search Engine=Wiki-18, Model Variant=Instruct2025.1023.233.9
RAGModel Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.108.914.8
R1-instructModel Backbone=Qwen2.5-3b, Search Engine=Wiki-18, Model Variant=Instruct2025.108.515.1
RAGModel Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.108.414.4
SFTModel Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.10813.8
SFTModel Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.107.713.9
R1-baseModel Backbone=Qwen2.5-3b, Search Engine=Wiki-18, Model Variant=Base2025.10712.7
R1-baseModel Backbone=Qwen2.5-7b, Search Engine=Wiki-18, Model Variant=Base2025.106.615.7
R1-instructModel Backbone=Qwen2.5-7b, Search Engine=Wiki-18, Model Variant=Instruct2025.10614.6
IRCoTModel Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.105.814.1
IRCoTModel Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.105.514.3
Search-o1Model Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.104.712.6
Search-o1Model Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.104.513.2
CoTModel Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.103.59.4
Direct InferenceModel Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.101.910.6
Direct InferenceModel Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.101.49.5
CoTModel Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.100.96.7