List your company
ResearchFormerly WizWand

Question Answering on MuSiQue (Guard Rate)

100Guard RateNaive
-4235077Jul 1, 2026
Updated 4mo ago

Evaluation results

MethodLinks
NaiveFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.07100
IgnoreFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.07100
Fake CompletionFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.07100
CombinedFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.07100
CombinedFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.0798.9
IgnoreFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.0798.9
Fake CompletionFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.0798.9
NaiveFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.0797.5
PoisonedRAGFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.0793.9
PoisonedRAGFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.0793.9
PARADOXFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.0793
PARADOXFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.0791.9
TopicFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.0783.2
TopicFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.0781.2
PARADOXFramework=WebThinker, LLM Backbone=QwQ-32B2026.0774.7
NaiveFramework=WebThinker, LLM Backbone=QwQ-32B2026.0758.6
Fake CompletionFramework=WebThinker, LLM Backbone=QwQ-32B2026.0758.5
PoisonedRAGFramework=WebThinker, LLM Backbone=QwQ-32B2026.0752.8
PARADOXFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.0747.9
IgnoreFramework=WebThinker, LLM Backbone=QwQ-32B2026.0742.7
TopicFramework=WebThinker, LLM Backbone=QwQ-32B2026.0741.6
TopicFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.0740
CombinedFramework=WebThinker, LLM Backbone=QwQ-32B2026.0735.7
PoisonedRAGFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.0733.7
NaiveFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.0731.7
Fake CompletionFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.0731.1
IgnoreFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.0725.3
CombinedFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.0716.7
KidnapRAGFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.077.9
KidnapRAGFramework=WebThinker, LLM Backbone=QwQ-32B2026.076.2
KidnapRAGFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.070
KidnapRAGFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.070