RAG Poisoning Attack Mitigation on NQ
1.8ASR (PIA)Perplexity Filter
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Perplexity FilterLLM=GPT-4o2025.06 | 1.8 | 7.2 | 24.4 | — | |
| Reranking (ColBERTv2)LLM=Mistral-7B2025.06 | 2 | 5 | 12 | — | |
| Perplexity FilterLLM=Mistral-7B2025.06 | 3.6 | 11.4 | 27.6 | — | |
| Reranking (ColBERTv2)LLM=GPT-4o2025.06 | 5.2 | 1 | 8 | — | |
| AV Filter(α=∞)LLM=Mistral-7B2025.06 | 5.8 | 4 | 4 | — | |
| Reranking (t5)LLM=Mistral-7B2025.06 | 6 | 7 | 13 | — | |
| Perplexity FilterLLM=Llama2-C2025.06 | 6.4 | 7.4 | 33 | — | |
| AV Filter(α=∞)LLM=Llama2-C2025.06 | 9.2 | 3.6 | 1.6 | — | |
| Reranking (t5)LLM=GPT-4o2025.06 | 10.6 | 2 | 9 | — | |
| Vigilant PromptLLM=GPT-4o2025.06 | 10.8 | 5.6 | 14.8 | — | |
| AV Filter(α=∞)LLM=GPT-4o2025.06 | 11.4 | 1.6 | 3.2 | — | |
| Reranking (ColBERTv2)LLM=Llama2-C2025.06 | 14 | 4 | 13 | — | |
| Vigilant PromptLLM=Mistral-7B2025.06 | 21.6 | 9.2 | 20.2 | — | |
| Reranking (t5)LLM=Llama2-C2025.06 | 31 | 6 | 19 | — | |
| Vigilant PromptLLM=Llama2-C2025.06 | 76 | 7.2 | 28.6 | — | |
| Cordon-MASSeed=422026.05 | — | — | — | 0 | |
| DebateSeed=422026.05 | — | — | — | 6.1 | |
| ParaphraseSeed=422026.05 | — | — | — | 10.2 | |
| RobustRAGSeed=422026.05 | — | — | — | 2 | |
| TrustRAGSeed=422026.05 | — | — | — | 8.2 | |
| Vanilla RAGSeed=422026.05 | — | — | — | 8.2 |