List your company
ResearchFormerly WizWand

Question Answering on NQ (test) (Acc, ASR)

70.2AccuracyVanilla RAG
12.79227.69642.657.504May 21, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Vanilla RAGScenario=Benign, top-k=10, Backbone=Deepseek2026.0570.2—
ReliabilityRAGScenario=PIA Attack, Position=10, top-k=10, Backbone=Deepseek2026.0567.86
ReliabilityRAGScenario=Benign, top-k=10, Backbone=Deepseek2026.0567.4—
RADARScenario=Benign, top-k=10, Backbone=Deepseek2026.0567—
Vanilla RAGScenario=Poison Attack, Position=10, top-k=10, Backbone=Deepseek2026.056613.4
ReliabilityRAGScenario=PIA Attack, Position=1, top-k=10, Backbone=Deepseek2026.0565.215
ReliabilityRAGScenario=Poison Attack, Position=10, top-k=10, Backbone=Deepseek2026.0565.25.6
RADARScenario=PIA Attack, Position=10, top-k=10, Backbone=Deepseek2026.0564.86.4
ReliabilityRAGScenario=Poison Attack, Position=1, top-k=10, Backbone=Deepseek2026.0564.811.4
RADARScenario=Poison Attack, Position=10, top-k=10, Backbone=Deepseek2026.0564.86.4
RADARScenario=PIA Attack, Position=1, top-k=10, Backbone=Deepseek2026.0563.47.8
RADARScenario=Poison Attack, Position=1, top-k=10, Backbone=Deepseek2026.05629.8
RobustRAGScenario=Benign, top-k=10, Backbone=Deepseek2026.0561.6—
RobustRAGScenario=PIA Attack, Position=10, top-k=10, Backbone=Deepseek2026.0560.22.2
RobustRAGScenario=Poison Attack, Position=10, top-k=10, Backbone=Deepseek2026.05602.4
InstructRAGScenario=Benign, top-k=10, Backbone=Deepseek2026.0557.4—
InstructRAGScenario=PIA Attack, Position=10, top-k=10, Backbone=Deepseek2026.0557.23.8
RobustRAGScenario=Poison Attack, Position=1, top-k=10, Backbone=Deepseek2026.0557.27.4
Vanilla RAGScenario=Poison Attack, Position=1, top-k=10, Backbone=Deepseek2026.055726.8
RobustRAGScenario=PIA Attack, Position=1, top-k=10, Backbone=Deepseek2026.0555.66.8
InstructRAGScenario=Poison Attack, Position=10, top-k=10, Backbone=Deepseek2026.0549.85.2
InstructRAGScenario=Poison Attack, Position=1, top-k=10, Backbone=Deepseek2026.0538.623.6
Vanilla RAGScenario=PIA Attack, Position=10, top-k=10, Backbone=Deepseek2026.0532.261
AstuteRAGScenario=Poison Attack, Position=10, top-k=10, Backbone=Deepseek2026.0531.21.8
AstuteRAGScenario=Benign, top-k=10, Backbone=Deepseek2026.0527.4—
AstuteRAGScenario=Poison Attack, Position=1, top-k=10, Backbone=Deepseek2026.0524.25.4
AstuteRAGScenario=PIA Attack, Position=1, top-k=10, Backbone=Deepseek2026.05234.4
AstuteRAGScenario=PIA Attack, Position=10, top-k=10, Backbone=Deepseek2026.0522.21.6
InstructRAGScenario=PIA Attack, Position=1, top-k=10, Backbone=Deepseek2026.0515.876.4
Vanilla RAGScenario=PIA Attack, Position=1, top-k=10, Backbone=Deepseek2026.051583.6