List your company
ResearchFormerly WizWand

Multi-hop Question Answering on Bamboogle Wiki-18

53.4Exact Match (EM)Esearch-base
1.81615.20828.641.992Oct 1, 2025
Updated 6mo ago

Evaluation results

MethodLinks
Esearch-baseModel Backbone=Qwen2.5-7b, Search Engine=Wiki-18, Model Variant=Base2025.1053.465.6
Esearch-instructModel Backbone=Qwen2.5-7b, Search Engine=Wiki-18, Model Variant=Instruct2025.1045.861.2
Esearch-instructModel Backbone=Qwen2.5-3b, Search Engine=Wiki-18, Model Variant=Instruct2025.1044.658.7
Esearch-baseModel Backbone=Qwen2.5-3b, Search Engine=Wiki-18, Model Variant=Base2025.1041.452.9
Search-o1Model Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.1033.639.7
RAGModel Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.1030.336.4
Search-o1Model Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.1028.136.6
R1-baseModel Backbone=Qwen2.5-7b, Search Engine=Wiki-18, Model Variant=Base2025.1027.733.5
RAGModel Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.1027.336.1
R1-instructModel Backbone=Qwen2.5-7b, Search Engine=Wiki-18, Model Variant=Instruct2025.1026.632.9
R1-baseModel Backbone=Qwen2.5-3b, Search Engine=Wiki-18, Model Variant=Base2025.1024.630.3
IRCoTModel Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.1023.729.6
IRCoTModel Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.1022.130.5
CoTModel Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.1021.429.9
R1-instructModel Backbone=Qwen2.5-3b, Search Engine=Wiki-18, Model Variant=Instruct2025.1020.429.7
CoTModel Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.1017.923.4
SFTModel Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.1012.417.8
Direct InferenceModel Backbone=Qwen2.5-7b, Search Engine=Wiki-182025.1010.719.1
SFTModel Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.101018.1
Direct InferenceModel Backbone=Qwen2.5-3b, Search Engine=Wiki-182025.103.89.9