Retrieval Attack Defense on FiQA
0ASRRAGPart
Evaluation Results
| Method | Links | |
|---|---|---|
| RAGPartRetriever=Contriever, Attack Type=HotFlip, N=5, k=32025.12 | 0 | |
| RAGPartRetriever=ANCE, Attack Type=HotFlip, N=5, k=12025.12 | 0 | |
| RAGPartRetriever=ANCE, Attack Type=HotFlip, N=5, k=32025.12 | 0 | |
| RAGPartRetriever=ANCE, Attack Type=Query as poison, N=5, k=32025.12 | 0 | |
| RAGPartRetriever=Multilingual E5, Attack Type=HotFlip, N=5, k=12025.12 | 0 | |
| RAGMaskRetriever=Multilingual E5, Attack Type=HotFlip, m=102025.12 | 0 | |
| RAGPartRetriever=Multilingual E5, Attack Type=HotFlip (spread out), N=5, k=12025.12 | 0 | |
| RAGPartRetriever=Multilingual E5, Attack Type=HotFlip (spread out), N=5, k=32025.12 | 0 | |
| RAGPartRetriever=Multilingual E5, Attack Type=Query as poison, N=5, k=32025.12 | 0 | |
| RAGPartRetriever=GTE Large, Attack Type=HotFlip, N=5, k=12025.12 | 0 | |
| RAGPartRetriever=GTE Large, Attack Type=HotFlip, N=5, k=32025.12 | 0 | |
| RAGMaskRetriever=GTE Large, Attack Type=HotFlip, m=102025.12 | 0 | |
| RAGPartRetriever=GTE Large, Attack Type=HotFlip (spread out), N=5, k=12025.12 | 0 | |
| RAGMaskRetriever=GTE Large, Attack Type=HotFlip (spread out), m=102025.12 | 0 | |
| RAGMaskRetriever=GTE Large, Attack Type=Query as poison, m=102025.12 | 0 | |
| RAGMaskRetriever=Contriever, Attack Type=HotFlip, m=102025.12 | 1 | |
| RAGPartRetriever=Contriever, Attack Type=Query as poison, N=5, k=32025.12 | 1 | |
| RAGPartRetriever=ANCE, Attack Type=HotFlip (spread out), N=5, k=32025.12 | 1 | |
| RAGPartRetriever=Multilingual E5, Attack Type=HotFlip, N=5, k=32025.12 | 1 | |
| RAGPartRetriever=GTE Large, Attack Type=Query as poison, N=5, k=32025.12 | 1 | |
| RAGPartRetriever=Contriever, Attack Type=HotFlip, N=5, k=12025.12 | 2 | |
| RAGPartRetriever=Contriever, Attack Type=HotFlip (spread out), N=5, k=12025.12 | 2 | |
| RAGPartRetriever=GTE Large, Attack Type=HotFlip (spread out), N=5, k=32025.12 | 2 | |
| RAGMaskRetriever=Contriever, Attack Type=HotFlip (spread out), m=102025.12 | 3 | |
| RAGMaskRetriever=Contriever, Attack Type=Query as poison, m=102025.12 | 3 | |
| RAGMaskRetriever=ANCE, Attack Type=HotFlip, m=102025.12 | 3 | |
| RAGMaskRetriever=ANCE, Attack Type=HotFlip (spread out), m=102025.12 | 3 | |
| RAGMaskRetriever=ANCE, Attack Type=Query as poison, m=102025.12 | 3 | |
| RAGPartRetriever=ANCE, Attack Type=AdvRAGgen, N=5, k=32025.12 | 4 | |
| Cordon-MASSeed=422026.05 | 4 | |
| RAGPartRetriever=ANCE, Attack Type=Query as poison, N=5, k=12025.12 | 5 | |
| RAGMaskRetriever=ANCE, Attack Type=AdvRAGgen, m=102025.12 | 5 | |
| RAGPartRetriever=GTE Large, Attack Type=Query as poison, N=5, k=12025.12 | 5 | |
| RAGMaskRetriever=GTE Large, Attack Type=AdvRAGgen, m=102025.12 | 5 | |
| RAGPartRetriever=Contriever, Attack Type=HotFlip (spread out), N=5, k=32025.12 | 6 | |
| RAGPartRetriever=ANCE, Attack Type=HotFlip (spread out), N=5, k=12025.12 | 6 | |
| RAGPartRetriever=ANCE, Attack Type=AdvRAGgen, N=5, k=12025.12 | 6 | |
| RAGPartRetriever=GTE Large, Attack Type=AdvRAGgen, N=5, k=32025.12 | 6 | |
| RAGMaskRetriever=Contriever, Attack Type=AdvRAGgen, m=102025.12 | 7 | |
| RAGMaskRetriever=Multilingual E5, Attack Type=HotFlip (spread out), m=102025.12 | 7 | |
| RAGMaskRetriever=Multilingual E5, Attack Type=Query as poison, m=102025.12 | 7 | |
| RAGMaskRetriever=Multilingual E5, Attack Type=AdvRAGgen, m=102025.12 | 7 | |
| RAGPartRetriever=GTE Large, Attack Type=AdvRAGgen, N=5, k=12025.12 | 8 | |
| RAGPartRetriever=Contriever, Attack Type=Query as poison, N=5, k=12025.12 | 9 | |
| RAGPartRetriever=Multilingual E5, Attack Type=Query as poison, N=5, k=12025.12 | 9 | |
| RobustRAGSeed=422026.05 | 10 | |
| RAGPartRetriever=Contriever, Attack Type=AdvRAGgen, N=5, k=32025.12 | 11 | |
| DebateSeed=422026.05 | 12 | |
| RAGPartRetriever=Contriever, Attack Type=AdvRAGgen, N=5, k=12025.12 | 13 | |
| RAGPartRetriever=Multilingual E5, Attack Type=AdvRAGgen, N=5, k=32025.12 | 14 | |
| TrustRAGSeed=422026.05 | 14 | |
| RAGPartRetriever=Multilingual E5, Attack Type=AdvRAGgen, N=5, k=12025.12 | 15 | |
| Vanilla RAGSeed=422026.05 | 18 | |
| No DefenseRetriever=GTE Large, Attack Type=HotFlip2025.12 | 20 | |
| No DefenseRetriever=Multilingual E5, Attack Type=HotFlip2025.12 | 21 | |
| No DefenseRetriever=Multilingual E5, Attack Type=HotFlip (spread out)2025.12 | 26 | |
| ParaphraseSeed=422026.05 | 26 | |
| No DefenseRetriever=GTE Large, Attack Type=HotFlip (spread out)2025.12 | 28 | |
| No DefenseRetriever=Multilingual E5, Attack Type=Query as poison2025.12 | 45 | |
| No DefenseRetriever=GTE Large, Attack Type=Query as poison2025.12 | 58 | |
| No DefenseRetriever=ANCE, Attack Type=Query as poison2025.12 | 65 | |
| No DefenseRetriever=ANCE, Attack Type=HotFlip (spread out)2025.12 | 67 | |
| No DefenseRetriever=ANCE, Attack Type=HotFlip2025.12 | 78 | |
| No DefenseRetriever=GTE Large, Attack Type=AdvRAGgen2025.12 | 83 | |
| No DefenseRetriever=Contriever, Attack Type=Query as poison2025.12 | 85 | |
| No DefenseRetriever=ANCE, Attack Type=AdvRAGgen2025.12 | 86 | |
| No DefenseRetriever=Contriever, Attack Type=HotFlip (spread out)2025.12 | 92 | |
| No DefenseRetriever=Contriever, Attack Type=AdvRAGgen2025.12 | 94 | |
| No DefenseRetriever=Contriever, Attack Type=HotFlip2025.12 | 95 | |
| No DefenseRetriever=Multilingual E5, Attack Type=AdvRAGgen2025.12 | 95 |