List your company
ResearchFormerly WizWand

Question Answering on HotpotQA (Guard Rate)

100Guard RateNaive
-4235077Jul 1, 2026
Updated 4mo ago

Evaluation results

MethodLinks
NaiveFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.07100
IgnoreFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.07100
Fake CompletionFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.07100
CombinedFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.07100
NaiveFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.07100
IgnoreFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.07100
Fake CompletionFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.07100
CombinedFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.07100
PARADOXFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.0793
PoisonedRAGFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.0791.9
PoisonedRAGFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.0791.9
TopicFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.0790.3
PARADOXFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.0787
TopicFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.0777.3
PARADOXFramework=WebThinker, LLM Backbone=QwQ-32B2026.0772.8
PoisonedRAGFramework=WebThinker, LLM Backbone=QwQ-32B2026.0745.2
PARADOXFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.0737.6
TopicFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.0734.4
NaiveFramework=WebThinker, LLM Backbone=QwQ-32B2026.0730.2
Fake CompletionFramework=WebThinker, LLM Backbone=QwQ-32B2026.0729.3
TopicFramework=WebThinker, LLM Backbone=QwQ-32B2026.0725.9
NaiveFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.0722.2
CombinedFramework=WebThinker, LLM Backbone=QwQ-32B2026.0718.3
Fake CompletionFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.0718.1
PoisonedRAGFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.0715.5
IgnoreFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.0713.6
IgnoreFramework=WebThinker, LLM Backbone=QwQ-32B2026.0712.5
KidnapRAGFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.079.8
CombinedFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.078
KidnapRAGFramework=WebThinker, LLM Backbone=QwQ-32B2026.074.2
KidnapRAGFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.070
KidnapRAGFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.070