# Question Answering on MuSiQue (EM, ASR) Source: [Question Answering on MuSiQue (EM, ASR)]() Collection index: [llms.txt]() Data updated: 2026-07-02T08:40:29.262Z Evaluation of model performance on the MuSiQue dataset for Question Answering tasks, measured using Exact Match (EM) and Answer Selection Rate (ASR). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Question Answering | | Dataset (including any stated split) | MuSiQue | | Metric | Exact Match (EM) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 36 of 36 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Exact Match (EM)](): Higher is better; unit: PERCENT. - [Answer Selection Rate (ASR)](): Higher is better; unit: PERCENT. ## Recorded results | Method | Exact Match (EM) | Result date | Report paper | | --- | --- | --- | --- | | Clean (No Attack) | 38 | Not recorded | 6a45f087dc71372d7795a25c | | PARADOX | 36 | Not recorded | 6a45f087dc71372d7795a25c | | PARADOX | 35 | Not recorded | 6a45f087dc71372d7795a25c | | Clean (No Attack) | 32 | Not recorded | 6a45f087dc71372d7795a25c | | Fake Completion | 30 | Not recorded | 6a45f087dc71372d7795a25c | | Naive | 28 | Not recorded | 6a45f087dc71372d7795a25c | | PARADOX | 28 | Not recorded | 6a45f087dc71372d7795a25c | | Naive | 26 | Not recorded | 6a45f087dc71372d7795a25c | | Clean (No Attack) | 23 | Not recorded | 6a45f087dc71372d7795a25c | | Ignore | 22 | Not recorded | 6a45f087dc71372d7795a25c | | Ignore | 22 | Not recorded | 6a45f087dc71372d7795a25c | | Naive | 21 | Not recorded | 6a45f087dc71372d7795a25c | | PoisonedRAG | 20 | Not recorded | 6a45f087dc71372d7795a25c | | Combined | 19 | Not recorded | 6a45f087dc71372d7795a25c | | Topic | 19 | Not recorded | 6a45f087dc71372d7795a25c | | Ignore | 19 | Not recorded | 6a45f087dc71372d7795a25c | | Combined | 19 | Not recorded | 6a45f087dc71372d7795a25c | | Naive | 18 | Not recorded | 6a45f087dc71372d7795a25c | | Fake Completion | 18 | Not recorded | 6a45f087dc71372d7795a25c | | PARADOX | 18 | Not recorded | 6a45f087dc71372d7795a25c | | Clean (No Attack) | 17 | Not recorded | 6a45f087dc71372d7795a25c | | Topic | 17 | Not recorded | 6a45f087dc71372d7795a25c | | Ignore | 16 | Not recorded | 6a45f087dc71372d7795a25c | | Combined | 16 | Not recorded | 6a45f087dc71372d7795a25c | | Fake Completion | 16 | Not recorded | 6a45f087dc71372d7795a25c | | Topic | 14 | Not recorded | 6a45f087dc71372d7795a25c | | PoisonedRAG | 13 | Not recorded | 6a45f087dc71372d7795a25c | | Fake Completion | 12 | Not recorded | 6a45f087dc71372d7795a25c | | Combined | 9 | Not recorded | 6a45f087dc71372d7795a25c | | Topic | 8 | Not recorded | 6a45f087dc71372d7795a25c | | KidnapRAG | 8 | Not recorded | 6a45f087dc71372d7795a25c | | PoisonedRAG | 8 | Not recorded | 6a45f087dc71372d7795a25c | | PoisonedRAG | 8 | Not recorded | 6a45f087dc71372d7795a25c | | KidnapRAG | 8 | Not recorded | 6a45f087dc71372d7795a25c | | KidnapRAG | 7 | Not recorded | 6a45f087dc71372d7795a25c | | KidnapRAG | 1 | Not recorded | 6a45f087dc71372d7795a25c | ### Clean (No Attack) Exact Match (EM): 38. Result ID: 6a4623fb60b88bb339854185. [Reporting paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Llama-3.3-70B-Inst"}. This record does not assert independent reproduction. ### PARADOX Exact Match (EM): 36. Result ID: 6a4623fb60b88bb33985418c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Llama-3.3-70B-Inst"}. This record does not assert independent reproduction. ### PARADOX Exact Match (EM): 35. Result ID: 6a4623fb60b88bb339854183. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Qwen2.5-32B-Inst"}. This record does not assert independent reproduction. ### Clean (No Attack) Exact Match (EM): 32. Result ID: 6a4623fb60b88bb33985417c. [Reporting paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Qwen2.5-32B-Inst"}. This record does not assert independent reproduction. ### Fake Completion Exact Match (EM): 30. Result ID: 6a4623fb60b88bb339854188. [Reporting paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Llama-3.3-70B-Inst"}. This record does not assert independent reproduction. ### Naive Exact Match (EM): 28. Result ID: 6a4623fb60b88bb339854186. [Reporting paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Llama-3.3-70B-Inst"}. This record does not assert independent reproduction. ### PARADOX Exact Match (EM): 28. Result ID: 6a4623fb60b88bb339854195. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"QwQ-32B"}. This record does not assert independent reproduction. ### Naive Exact Match (EM): 26. Result ID: 6a4623fb60b88bb33985418f. [Reporting paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"QwQ-32B"}. This record does not assert independent reproduction. ### Clean (No Attack) Exact Match (EM): 23. Result ID: 6a4623fb60b88bb33985418e. [Reporting paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"QwQ-32B"}. This record does not assert independent reproduction. ### Ignore Exact Match (EM): 22. Result ID: 6a4623fb60b88bb33985417e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Qwen2.5-32B-Inst"}. This record does not assert independent reproduction. ### Ignore Exact Match (EM): 22. Result ID: 6a4623fb60b88bb339854190. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"QwQ-32B"}. This record does not assert independent reproduction. ### Naive Exact Match (EM): 21. Result ID: 6a4623fb60b88bb339854198. [Reporting paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"DeepSeek-32B"}. This record does not assert independent reproduction. ### PoisonedRAG Exact Match (EM): 20. Result ID: 6a4623fb60b88bb33985418b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Llama-3.3-70B-Inst"}. This record does not assert independent reproduction. ### Combined Exact Match (EM): 19. Result ID: 6a4623fb60b88bb339854192. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"QwQ-32B"}. This record does not assert independent reproduction. ### Topic Exact Match (EM): 19. Result ID: 6a4623fb60b88bb339854193. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"QwQ-32B"}. This record does not assert independent reproduction. ### Ignore Exact Match (EM): 19. Result ID: 6a4623fb60b88bb339854199. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"DeepSeek-32B"}. This record does not assert independent reproduction. ### Combined Exact Match (EM): 19. Result ID: 6a4623fb60b88bb33985419b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"DeepSeek-32B"}. This record does not assert independent reproduction. ### Naive Exact Match (EM): 18. Result ID: 6a4623fb60b88bb33985417d. [Reporting paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Qwen2.5-32B-Inst"}. This record does not assert independent reproduction. ### Fake Completion Exact Match (EM): 18. Result ID: 6a4623fb60b88bb339854191. [Reporting paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"QwQ-32B"}. This record does not assert independent reproduction. ### PARADOX Exact Match (EM): 18. Result ID: 6a4623fb60b88bb33985419e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"DeepSeek-32B"}. This record does not assert independent reproduction. ### Clean (No Attack) Exact Match (EM): 17. Result ID: 6a4623fb60b88bb339854197. [Reporting paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"DeepSeek-32B"}. This record does not assert independent reproduction. ### Topic Exact Match (EM): 17. Result ID: 6a4623fb60b88bb33985419c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"DeepSeek-32B"}. This record does not assert independent reproduction. ### Ignore Exact Match (EM): 16. Result ID: 6a4623fb60b88bb339854187. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Llama-3.3-70B-Inst"}. This record does not assert independent reproduction. ### Combined Exact Match (EM): 16. Result ID: 6a4623fb60b88bb339854189. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Llama-3.3-70B-Inst"}. This record does not assert independent reproduction. ### Fake Completion Exact Match (EM): 16. Result ID: 6a4623fb60b88bb33985419a. [Reporting paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"DeepSeek-32B"}. This record does not assert independent reproduction. ### Topic Exact Match (EM): 14. Result ID: 6a4623fb60b88bb33985418a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Llama-3.3-70B-Inst"}. This record does not assert independent reproduction. ### PoisonedRAG Exact Match (EM): 13. Result ID: 6a4623fb60b88bb339854182. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Qwen2.5-32B-Inst"}. This record does not assert independent reproduction. ### Fake Completion Exact Match (EM): 12. Result ID: 6a4623fb60b88bb33985417f. [Reporting paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Qwen2.5-32B-Inst"}. This record does not assert independent reproduction. ### Combined Exact Match (EM): 9. Result ID: 6a4623fb60b88bb339854180. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Qwen2.5-32B-Inst"}. This record does not assert independent reproduction. ### Topic Exact Match (EM): 8. Result ID: 6a4623fb60b88bb339854181. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Qwen2.5-32B-Inst"}. This record does not assert independent reproduction. ### KidnapRAG Exact Match (EM): 8. Result ID: 6a4623fb60b88bb339854184. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Qwen2.5-32B-Inst"}. This record does not assert independent reproduction. ### PoisonedRAG Exact Match (EM): 8. Result ID: 6a4623fb60b88bb339854194. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"QwQ-32B"}. This record does not assert independent reproduction. ### PoisonedRAG Exact Match (EM): 8. Result ID: 6a4623fb60b88bb33985419d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"DeepSeek-32B"}. This record does not assert independent reproduction. ### KidnapRAG Exact Match (EM): 8. Result ID: 6a4623fb60b88bb33985419f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"DeepSeek-32B"}. This record does not assert independent reproduction. ### KidnapRAG Exact Match (EM): 7. Result ID: 6a4623fb60b88bb339854196. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"WebThinker","LLM Backbone":"QwQ-32B"}. This record does not assert independent reproduction. ### KidnapRAG Exact Match (EM): 1. Result ID: 6a4623fb60b88bb33985418d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"ReAct","LLM Backbone":"Llama-3.3-70B-Inst"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.