RAG Poisoning Attack on TriviaQA
1.56E2E Attack Success RateGCG
Evaluation Results
| Method | Links | |
|---|---|---|
| GCGRetriever=Qwen3 Emb 0.6B, Generator=Gemma 2B2025.10 | 1.56 | |
| AutoDANRetriever=Qwen3 Emb 0.6B, Generator=Gemma 2B2025.10 | 2.16 | |
| GCGRetriever=BCE, Generator=Qwen2.5 0.5B2025.10 | 2.72 | |
| GCGRetriever=BCE, Generator=Llama3.2 1B2025.10 | 4.09 | |
| Phantom (MCG)Retriever=Qwen3 Emb 0.6B, Generator=Qwen2.5 0.5B2025.10 | 4.69 | |
| Phantom (MCG)Retriever=BCE, Generator=Qwen2.5 0.5B2025.10 | 5.92 | |
| GCGRetriever=Qwen3 Emb 0.6B, Generator=Llama3.2 1B2025.10 | 5.97 | |
| AutoDANRetriever=BCE, Generator=Gemma 2B2025.10 | 6.13 | |
| GCGRetriever=Qwen3 Emb 0.6B, Generator=Qwen2.5 0.5B2025.10 | 6.72 | |
| Phantom (MCG)Retriever=BCE, Generator=Llama3.2 1B2025.10 | 7.69 | |
| AutoDANRetriever=BCE, Generator=Llama3.2 1B2025.10 | 7.84 | |
| Phantom (MCG)Retriever=Qwen3 Emb 0.6B, Generator=Llama3.2 1B2025.10 | 8.66 | |
| GCGRetriever=BCE, Generator=Gemma 2B2025.10 | 14.16 | |
| AutoDANRetriever=Qwen3 Emb 0.6B, Generator=Llama3.2 1B2025.10 | 15.38 | |
| LLM-GenRetriever=Qwen3 Emb 0.6B, Generator=Llama3.2 1B2025.10 | 17.12 | |
| LLM-GenRetriever=BCE, Generator=Llama3.2 1B2025.10 | 17.12 | |
| Phantom (MCG)Retriever=BCE, Generator=Gemma 2B2025.10 | 18.22 | |
| AutoDANRetriever=Qwen3 Emb 0.6B, Generator=Qwen2.5 0.5B2025.10 | 19.5 | |
| AutoDANRetriever=BCE, Generator=Qwen2.5 0.5B2025.10 | 21.78 | |
| EYES-ON-MERetriever=BCE, Generator=Llama3.2 1B2025.10 | 23.73 | |
| EYES-ON-MERetriever=BCE, Generator=Qwen2.5 0.5B2025.10 | 25.23 | |
| Phantom (MCG)Retriever=Qwen3 Emb 0.6B, Generator=Gemma 2B2025.10 | 25.64 | |
| EYES-ON-MERetriever=Qwen3 Emb 0.6B, Generator=Gemma 2B2025.10 | 25.93 | |
| LLM-GenRetriever=Qwen3 Emb 0.6B, Generator=Gemma 2B2025.10 | 26.06 | |
| LLM-GenRetriever=BCE, Generator=Gemma 2B2025.10 | 26.06 | |
| EYES-ON-MERetriever=Qwen3 Emb 0.6B, Generator=Qwen2.5 0.5B2025.10 | 26.93 | |
| EYES-ON-MERetriever=Qwen3 Emb 0.6B, Generator=Llama3.2 1B2025.10 | 28.34 | |
| EYES-ON-ME + LLM-GenRetriever=BCE, Generator=Llama3.2 1B2025.10 | 32.69 | |
| EYES-ON-ME + LLM-GenRetriever=BCE, Generator=Qwen2.5 0.5B2025.10 | 32.81 | |
| LLM-GenRetriever=Qwen3 Emb 0.6B, Generator=Qwen2.5 0.5B2025.10 | 36.01 | |
| LLM-GenRetriever=BCE, Generator=Qwen2.5 0.5B2025.10 | 36.01 | |
| EYES-ON-MERetriever=BCE, Generator=Gemma 2B2025.10 | 39.88 | |
| EYES-ON-ME + LLM-GenRetriever=Qwen3 Emb 0.6B, Generator=Gemma 2B2025.10 | 56.25 | |
| EYES-ON-ME + LLM-GenRetriever=BCE, Generator=Gemma 2B2025.10 | 76.95 | |
| EYES-ON-ME + LLM-GenRetriever=Qwen3 Emb 0.6B, Generator=Qwen2.5 0.5B2025.10 | 77.4 | |
| EYES-ON-ME + LLM-GenRetriever=Qwen3 Emb 0.6B, Generator=Llama3.2 1B2025.10 | 87.5 |