Adversarial Attack on RAG on Natural Questions (NQ)
96.74SASRDEJA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DEJALanguage Model=Llama-2-7B, Retriever=Contriever2026.04 | 96.74 | 1.09 | 0.27 | |
| DEJALanguage Model=Llama-2-13B, Retriever=Contriever2026.04 | 95.7 | 0 | 0.29 | |
| DEJAGenerator=Llama-2-7B, Retriever=GTR-base2026.04 | 92.27 | 0.97 | 0.31 | |
| DEJAGenerator=Llama-2-13B, Retriever=GTR-base2026.04 | 88.15 | 1.85 | 0.42 | |
| DEJALanguage Model=Mistral-7B, Retriever=Contriever2026.04 | 86.67 | 0 | 0.47 | |
| Prompt InjectionLanguage Model=Mistral-7B, Retriever=Contriever2026.04 | 82.22 | 8.89 | 0.79 | |
| DEJAGenerator=Mistral-7B, Retriever=GTR-base2026.04 | 81.76 | 0 | 0.52 | |
| Prompt InjectionGenerator=Mistral-7B, Retriever=GTR-base2026.04 | 71.23 | 2.81 | 0.94 | |
| PoisonedRAGGenerator=Llama-2-7B, Retriever=GTR-base2026.04 | 64.74 | 5.8 | 0.85 | |
| PoisonedRAGLanguage Model=Llama-2-7B, Retriever=Contriever2026.04 | 58.7 | 7.61 | 0.92 | |
| JammingLanguage Model=Llama-2-7B, Retriever=Contriever2026.04 | 54 | 11 | 1.07 | |
| JammingLanguage Model=Llama-2-13B, Retriever=Contriever2026.04 | 48 | 10 | 1.1 | |
| Prompt InjectionLanguage Model=Llama-2-7B, Retriever=Contriever2026.04 | 45.65 | 43.48 | 1.15 | |
| Prompt InjectionLanguage Model=Llama-2-13B, Retriever=Contriever2026.04 | 44.09 | 46.24 | 1.17 | |
| PoisonedRAGLanguage Model=Llama-2-13B, Retriever=Contriever2026.04 | 44.09 | 13.98 | 1.1 | |
| Prompt InjectionGenerator=Llama-2-7B, Retriever=GTR-base2026.04 | 41.55 | 30.43 | 1.28 | |
| PoisonedRAGLanguage Model=Mistral-7B, Retriever=Contriever2026.04 | 41.11 | 2.22 | 1.15 | |
| PoisonedRAGGenerator=Mistral-7B, Retriever=GTR-base2026.04 | 40.35 | 1.4 | 1.16 | |
| JammingLanguage Model=Mistral-7B, Retriever=Contriever2026.04 | 40 | 10 | 1.27 | |
| JammingGenerator=Llama-2-7B, Retriever=GTR-base2026.04 | 39 | 33.33 | 1.57 | |
| Prompt InjectionGenerator=Llama-2-13B, Retriever=GTR-base2026.04 | 38.89 | 34.45 | 1.3 | |
| JammingGenerator=Llama-2-13B, Retriever=GTR-base2026.04 | 38.67 | 12.67 | 1.27 | |
| PoisonedRAGGenerator=Llama-2-13B, Retriever=GTR-base2026.04 | 37.04 | 8.15 | 1.21 | |
| JammingGenerator=Mistral-7B, Retriever=GTR-base2026.04 | 34 | 5.33 | 1.25 |