Question Answering on NQ (test) (Acc, ASR)
70.2AccuracyVanilla RAG
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Vanilla RAGScenario=Benign, top-k=10, Backbone=Deepseek2026.05 | 70.2 | — | |
| ReliabilityRAGScenario=PIA Attack, Position=10, top-k=10, Backbone=Deepseek2026.05 | 67.8 | 6 | |
| ReliabilityRAGScenario=Benign, top-k=10, Backbone=Deepseek2026.05 | 67.4 | — | |
| RADARScenario=Benign, top-k=10, Backbone=Deepseek2026.05 | 67 | — | |
| Vanilla RAGScenario=Poison Attack, Position=10, top-k=10, Backbone=Deepseek2026.05 | 66 | 13.4 | |
| ReliabilityRAGScenario=PIA Attack, Position=1, top-k=10, Backbone=Deepseek2026.05 | 65.2 | 15 | |
| ReliabilityRAGScenario=Poison Attack, Position=10, top-k=10, Backbone=Deepseek2026.05 | 65.2 | 5.6 | |
| RADARScenario=PIA Attack, Position=10, top-k=10, Backbone=Deepseek2026.05 | 64.8 | 6.4 | |
| ReliabilityRAGScenario=Poison Attack, Position=1, top-k=10, Backbone=Deepseek2026.05 | 64.8 | 11.4 | |
| RADARScenario=Poison Attack, Position=10, top-k=10, Backbone=Deepseek2026.05 | 64.8 | 6.4 | |
| RADARScenario=PIA Attack, Position=1, top-k=10, Backbone=Deepseek2026.05 | 63.4 | 7.8 | |
| RADARScenario=Poison Attack, Position=1, top-k=10, Backbone=Deepseek2026.05 | 62 | 9.8 | |
| RobustRAGScenario=Benign, top-k=10, Backbone=Deepseek2026.05 | 61.6 | — | |
| RobustRAGScenario=PIA Attack, Position=10, top-k=10, Backbone=Deepseek2026.05 | 60.2 | 2.2 | |
| RobustRAGScenario=Poison Attack, Position=10, top-k=10, Backbone=Deepseek2026.05 | 60 | 2.4 | |
| InstructRAGScenario=Benign, top-k=10, Backbone=Deepseek2026.05 | 57.4 | — | |
| InstructRAGScenario=PIA Attack, Position=10, top-k=10, Backbone=Deepseek2026.05 | 57.2 | 3.8 | |
| RobustRAGScenario=Poison Attack, Position=1, top-k=10, Backbone=Deepseek2026.05 | 57.2 | 7.4 | |
| Vanilla RAGScenario=Poison Attack, Position=1, top-k=10, Backbone=Deepseek2026.05 | 57 | 26.8 | |
| RobustRAGScenario=PIA Attack, Position=1, top-k=10, Backbone=Deepseek2026.05 | 55.6 | 6.8 | |
| InstructRAGScenario=Poison Attack, Position=10, top-k=10, Backbone=Deepseek2026.05 | 49.8 | 5.2 | |
| InstructRAGScenario=Poison Attack, Position=1, top-k=10, Backbone=Deepseek2026.05 | 38.6 | 23.6 | |
| Vanilla RAGScenario=PIA Attack, Position=10, top-k=10, Backbone=Deepseek2026.05 | 32.2 | 61 | |
| AstuteRAGScenario=Poison Attack, Position=10, top-k=10, Backbone=Deepseek2026.05 | 31.2 | 1.8 | |
| AstuteRAGScenario=Benign, top-k=10, Backbone=Deepseek2026.05 | 27.4 | — | |
| AstuteRAGScenario=Poison Attack, Position=1, top-k=10, Backbone=Deepseek2026.05 | 24.2 | 5.4 | |
| AstuteRAGScenario=PIA Attack, Position=1, top-k=10, Backbone=Deepseek2026.05 | 23 | 4.4 | |
| AstuteRAGScenario=PIA Attack, Position=10, top-k=10, Backbone=Deepseek2026.05 | 22.2 | 1.6 | |
| InstructRAGScenario=PIA Attack, Position=1, top-k=10, Backbone=Deepseek2026.05 | 15.8 | 76.4 | |
| Vanilla RAGScenario=PIA Attack, Position=1, top-k=10, Backbone=Deepseek2026.05 | 15 | 83.6 |