Question Answering on HotpotQA (Guard Rate)
100Guard RateNaive
Evaluation Results
| Method | Links | |
|---|---|---|
| NaiveFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.07 | 100 | |
| IgnoreFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.07 | 100 | |
| Fake CompletionFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.07 | 100 | |
| CombinedFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.07 | 100 | |
| NaiveFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.07 | 100 | |
| IgnoreFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.07 | 100 | |
| Fake CompletionFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.07 | 100 | |
| CombinedFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.07 | 100 | |
| PARADOXFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.07 | 93 | |
| PoisonedRAGFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.07 | 91.9 | |
| PoisonedRAGFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.07 | 91.9 | |
| TopicFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.07 | 90.3 | |
| PARADOXFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.07 | 87 | |
| TopicFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.07 | 77.3 | |
| PARADOXFramework=WebThinker, LLM Backbone=QwQ-32B2026.07 | 72.8 | |
| PoisonedRAGFramework=WebThinker, LLM Backbone=QwQ-32B2026.07 | 45.2 | |
| PARADOXFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.07 | 37.6 | |
| TopicFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.07 | 34.4 | |
| NaiveFramework=WebThinker, LLM Backbone=QwQ-32B2026.07 | 30.2 | |
| Fake CompletionFramework=WebThinker, LLM Backbone=QwQ-32B2026.07 | 29.3 | |
| TopicFramework=WebThinker, LLM Backbone=QwQ-32B2026.07 | 25.9 | |
| NaiveFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.07 | 22.2 | |
| CombinedFramework=WebThinker, LLM Backbone=QwQ-32B2026.07 | 18.3 | |
| Fake CompletionFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.07 | 18.1 | |
| PoisonedRAGFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.07 | 15.5 | |
| IgnoreFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.07 | 13.6 | |
| IgnoreFramework=WebThinker, LLM Backbone=QwQ-32B2026.07 | 12.5 | |
| KidnapRAGFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.07 | 9.8 | |
| CombinedFramework=WebThinker, LLM Backbone=DeepSeek-32B2026.07 | 8 | |
| KidnapRAGFramework=WebThinker, LLM Backbone=QwQ-32B2026.07 | 4.2 | |
| KidnapRAGFramework=ReAct, LLM Backbone=Qwen2.5-32B-Inst2026.07 | 0 | |
| KidnapRAGFramework=ReAct, LLM Backbone=Llama-3.3-70B-Inst2026.07 | 0 |