List your company
ResearchFormerly WizWand

Multi-hop Question Answering on HotpotQA Wiki-18

44.7Exact MatchEsearch-instruct
2.0613.1324.235.27Oct 1, 2025
Updated 6mo ago

Evaluation results

MethodLinks
Esearch-instructModel Backbone=Qwen2.5-3b, Search Engine=Wiki-18, Model Variant=Instruct2025.1044.758.7
Esearch-instructModel Backbone=Qwen2.5-7b, Search Engine=Wiki-18, Model Variant=Instruct2025.1044.257.6
Esearch-baseModel Backbone=Qwen2.5-7b, Search Engine=Wiki-18, Model Variant=Base2025.1043.456.4
Esearch-baseModel Backbone=Qwen2.5-3b, Search Engine=Wiki-18, Model Variant=Base2025.1041.554.8
RAGModel Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.1031.737.5
RAGModel Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.1028.536.6
R1-instructModel Backbone=Qwen2.5-7b, Search Engine=Wiki-18, Model Variant=Instruct2025.1025.431.4
R1-baseModel Backbone=Qwen2.5-3b, Search Engine=Wiki-18, Model Variant=Base2025.1023.929.4
SFTModel Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.1023.328.7
R1-baseModel Backbone=Qwen2.5-7b, Search Engine=Wiki-18, Model Variant=Base2025.1021.230.1
Search-o1Model Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.1020.625.7
Search-o1Model Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.1020.428.7
Direct InferenceModel Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.1020.124.8
SFTModel Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.1019.725.2
R1-instructModel Backbone=Qwen2.5-3b, Search Engine=Wiki-18, Model Variant=Instruct2025.1019.427.9
Direct InferenceModel Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.1016.721.4
IRCoTModel Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.1012.120.6
CoTModel Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.107.916.5
IRCoTModel Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.107.713.5
CoTModel Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.103.79.9