RAG Poisoning Attack on Natural Questions
64.08E2E-ASREYES-ON-ME + LLM-Gen
Evaluation Results
| Method | Links | |
|---|---|---|
| EYES-ON-ME + LLM-GenRetriever=Qwen3 Emb 0.6B, Generator=Llama3.2 1B2025.10 | 64.08 | |
| EYES-ON-ME + LLM-GenRetriever=Qwen3 Emb 0.6B, Generator=Qwen2.5 0.5B2025.10 | 64.08 | |
| EYES-ON-ME + LLM-GenRetriever=BCE, Generator=Gemma 2B2025.10 | 60.63 | |
| EYES-ON-ME + LLM-GenRetriever=BCE, Generator=Qwen2.5 0.5B2025.10 | 53.4 | |
| EYES-ON-MERetriever=BCE, Generator=Gemma 2B2025.10 | 41.03 | |
| LLM-GenRetriever=Qwen3 Emb 0.6B, Generator=Qwen2.5 0.5B2025.10 | 36.01 | |
| LLM-GenRetriever=BCE, Generator=Qwen2.5 0.5B2025.10 | 36.01 | |
| EYES-ON-ME + LLM-GenRetriever=BCE, Generator=Llama3.2 1B2025.10 | 33.97 | |
| EYES-ON-MERetriever=Qwen3 Emb 0.6B, Generator=Gemma 2B2025.10 | 33.75 | |
| EYES-ON-MERetriever=BCE, Generator=Qwen2.5 0.5B2025.10 | 31.08 | |
| AutoDANRetriever=BCE, Generator=Qwen2.5 0.5B2025.10 | 29.7 | |
| EYES-ON-MERetriever=Qwen3 Emb 0.6B, Generator=Llama3.2 1B2025.10 | 28.57 | |
| EYES-ON-MERetriever=BCE, Generator=Llama3.2 1B2025.10 | 28.34 | |
| EYES-ON-MERetriever=Qwen3 Emb 0.6B, Generator=Qwen2.5 0.5B2025.10 | 26.77 | |
| EYES-ON-ME + LLM-GenRetriever=Qwen3 Emb 0.6B, Generator=Gemma 2B2025.10 | 26.21 | |
| LLM-GenRetriever=Qwen3 Emb 0.6B, Generator=Gemma 2B2025.10 | 26.06 | |
| LLM-GenRetriever=BCE, Generator=Gemma 2B2025.10 | 26.06 | |
| Phantom (MCG)Retriever=BCE, Generator=Qwen2.5 0.5B2025.10 | 23.23 | |
| AutoDANRetriever=Qwen3 Emb 0.6B, Generator=Qwen2.5 0.5B2025.10 | 21.78 | |
| LLM-GenRetriever=Qwen3 Emb 0.6B, Generator=Llama3.2 1B2025.10 | 17.12 | |
| LLM-GenRetriever=BCE, Generator=Llama3.2 1B2025.10 | 17.12 | |
| Phantom (MCG)Retriever=BCE, Generator=Llama3.2 1B2025.10 | 13.24 | |
| AutoDANRetriever=BCE, Generator=Gemma 2B2025.10 | 12.5 | |
| AutoDANRetriever=Qwen3 Emb 0.6B, Generator=Llama3.2 1B2025.10 | 10.58 | |
| Phantom (MCG)Retriever=BCE, Generator=Gemma 2B2025.10 | 9.68 | |
| GCGRetriever=BCE, Generator=Gemma 2B2025.10 | 8.42 | |
| Phantom (MCG)Retriever=Qwen3 Emb 0.6B, Generator=Gemma 2B2025.10 | 7.99 | |
| AutoDANRetriever=BCE, Generator=Llama3.2 1B2025.10 | 7.03 | |
| Phantom (MCG)Retriever=Qwen3 Emb 0.6B, Generator=Qwen2.5 0.5B2025.10 | 6.2 | |
| GCGRetriever=Qwen3 Emb 0.6B, Generator=Qwen2.5 0.5B2025.10 | 5.63 | |
| GCGRetriever=BCE, Generator=Qwen2.5 0.5B2025.10 | 4.86 | |
| GCGRetriever=BCE, Generator=Llama3.2 1B2025.10 | 3.47 | |
| GCGRetriever=Qwen3 Emb 0.6B, Generator=Gemma 2B2025.10 | 2.64 | |
| Phantom (MCG)Retriever=Qwen3 Emb 0.6B, Generator=Llama3.2 1B2025.10 | 2.12 | |
| AutoDANRetriever=Qwen3 Emb 0.6B, Generator=Gemma 2B2025.10 | 1.96 | |
| GCGRetriever=Qwen3 Emb 0.6B, Generator=Llama3.2 1B2025.10 | 0.97 |