List your company
ResearchFormerly WizWand

Question Answering on TQA (Acc., ASR)

76.8AccuracyReliabilityRAG
5.24823.82442.460.976May 21, 2026
Updated 5mo ago

Evaluation results

MethodLinks
ReliabilityRAGTop-k=50, Pos=50, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0576.85.6
ReliabilityRAGTop-k=50, Pos=25, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0575.89
ReliabilityRAGTop-k=50, Pos=Pos 25, Generator LLM=Grok-4-fast2026.0574.68.8
RADARTop-k=50, Pos=50, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0572.216
ReliabilityRAGTop-k=50, Pos=Pos 50, Generator LLM=Grok-4-fast2026.0571.84.2
RADARTop-k=50, Pos=Pos 50, Generator LLM=Grok-4-fast2026.0571.810
RADARTop-k=50, Pos=25, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0571.216.2
RobustRAGTop-k=50, Pos=50, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0571.216.8
RobustRAGTop-k=50, Pos=25, Attack Type=PIA attack, Generator LLM=GPT-4o2026.057117
RADARTop-k=10, Pos=Pos 10, Generator LLM=Grok-4-fast2026.057112.8
AstuteRAGTop-k=10, Pos=Pos 10, Generator LLM=Grok-4-fast2026.0570.83.6
ReliabilityRAGTop-k=10, Pos=Pos 10, Generator LLM=Grok-4-fast2026.0570.215.2
RADARTop-k=50, Pos=Pos 25, Generator LLM=Grok-4-fast2026.0570.210
AstuteRAGTop-k=50, Pos=25, Attack Type=PIA attack, Generator LLM=GPT-4o2026.057016.4
RobustRAGTop-k=50, Pos=Pos 25, Generator LLM=Grok-4-fast2026.057010.2
RobustRAGTop-k=50, Pos=Pos 50, Generator LLM=Grok-4-fast2026.0569.85.6
RADARTop-k=10, Pos=10, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0569.424.2
RobustRAGTop-k=10, Pos=10, Attack Type=PIA attack, Generator LLM=GPT-4o2026.056918.4
RobustRAGTop-k=10, Pos=Pos 10, Generator LLM=Grok-4-fast2026.056918.4
ReliabilityRAGTop-k=10, Pos=10, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0568.822.4
AstuteRAGTop-k=50, Pos=50, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0568.811.2
RADARTop-k=50, Pos=Pos 1, Generator LLM=Grok-4-fast2026.0567.613.8
InstructRAGTop-k=50, Pos=Pos 50, Generator LLM=Grok-4-fast2026.0567.64.4
RobustRAGTop-k=50, Pos=Pos 1, Generator LLM=Grok-4-fast2026.0567.215.8
AstuteRAGTop-k=50, Pos=Pos 25, Generator LLM=Grok-4-fast2026.0566.83.2
AstuteRAGTop-k=50, Pos=Pos 1, Generator LLM=Grok-4-fast2026.0566.63.8
AstuteRAGTop-k=50, Pos=Pos 50, Generator LLM=Grok-4-fast2026.0566.63
RobustRAGTop-k=10, Pos=Pos 1, Generator LLM=Grok-4-fast2026.056616.2
RADARTop-k=10, Pos=Pos 1, Generator LLM=Grok-4-fast2026.056618.8
InstructRAGTop-k=50, Pos=Pos 25, Generator LLM=Grok-4-fast2026.05664.4
AstuteRAGTop-k=10, Pos=10, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0565.213
AstuteRAGTop-k=10, Pos=Pos 1, Generator LLM=Grok-4-fast2026.05653.8
InstructRAGTop-k=10, Pos=Pos 10, Generator LLM=Grok-4-fast2026.0564.45.2
RADARTop-k=50, Pos=1, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0563.632
RobustRAGTop-k=50, Pos=1, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0563.528.2
ReliabilityRAGTop-k=10, Pos=Pos 1, Generator LLM=Grok-4-fast2026.0562.630.6
RADARTop-k=10, Pos=1, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0561.433.4
RobustRAGTop-k=10, Pos=1, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0561.223.4
InstructRAGTop-k=10, Pos=10, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0560.828.6
ReliabilityRAGTop-k=50, Pos=1, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0560.835.2
AstuteRAGTop-k=50, Pos=1, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0559.430.4
ReliabilityRAGTop-k=50, Pos=Pos 1, Generator LLM=Grok-4-fast2026.0559.437.6
InstructRAGTop-k=50, Pos=25, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0558.217.1
ReliabilityRAGTop-k=10, Pos=1, Attack Type=PIA attack, Generator LLM=GPT-4o2026.055840.6
InstructRAGTop-k=50, Pos=50, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0557.235
AstuteRAGTop-k=10, Pos=1, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0555.235.2
InstructRAGTop-k=10, Pos=Pos 1, Generator LLM=Grok-4-fast2026.0551.625.2
InstructRAGTop-k=50, Pos=Pos 1, Generator LLM=Grok-4-fast2026.0549.830.4
InstructRAGTop-k=10, Pos=1, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0548.841.4
InstructRAGTop-k=50, Pos=1, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0548.438.4
Vanilla RAGTop-k=50, Pos=25, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0547.237.8
Vanilla RAGTop-k=50, Pos=50, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0546.232.8
Vanilla RAGTop-k=50, Pos=Pos 50, Generator LLM=Grok-4-fast2026.0543.243.6
Vanilla RAGTop-k=50, Pos=Pos 25, Generator LLM=Grok-4-fast2026.054155.6
Vanilla RAGTop-k=10, Pos=10, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0538.843.4
Vanilla RAGTop-k=10, Pos=1, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0536.850.6
Vanilla RAGTop-k=10, Pos=Pos 10, Generator LLM=Grok-4-fast2026.0533.463.8
Vanilla RAGTop-k=50, Pos=1, Attack Type=PIA attack, Generator LLM=GPT-4o2026.0532.650.6
Vanilla RAGTop-k=10, Pos=Pos 1, Generator LLM=Grok-4-fast2026.051189
Vanilla RAGTop-k=50, Pos=Pos 1, Generator LLM=Grok-4-fast2026.05892