List your company
ResearchFormerly WizWand

Multi-Hop Question Answering on HotpotQA (Helmet correctness score)

1.86Helmet ScoreEXTAGENTS
0.9241.1671.411.653May 27, 2025
Updated 6mo ago

Evaluation results

MethodLinks
EXTAGENTSBase Model=gpt-4o-2024-08-06, Input length (#tokens)=1024k2025.051.86
Direct InputBase Model=gpt-4o-mini-2024-07-18, Input length (#tokens)=128k2025.051.83
EXTAGENTS (N = 1)Base Model=gpt-4o-2024-08-06, Input length (#tokens)=128k2025.051.73
ExtAgents (Ours)Base Model=gpt-4o-mini-2024-07-18, Input length (#tokens)=1024k2025.051.71
IterDRAGBase Model=gpt-4o-mini-2024-07-18, Input length (#tokens)=128k2025.051.7
Direct InputBase Model=DeepSeek-R1-Distill-Llama-8B, Input length (#tokens)=32k2025.051.56
DRAGBase Model=gpt-4o-mini-2024-07-18, Input length (#tokens)=128k2025.051.53
ExtAgents (Ours)Base Model=Llama-3.1-8B-Instruct, Input length (#tokens)=1024k2025.051.38
DRAGBase Model=Llama-3.1-8B-Instruct, Input length (#tokens)=32k2025.051.2
IterDRAGBase Model=Llama-3.1-8B-Instruct, Input length (#tokens)=32k2025.051.14
Direct InputBase Model=Llama-3.1-8B-Instruct, Input length (#tokens)=128k2025.050.96