List your company
ResearchFormerly WizWand

RAG Leakage Attack on FIQA

66.8CCLTGTB
-2.46415.51833.551.482May 7, 2026
Updated 5mo ago

Evaluation results

MethodLinks
TGTBTarget LLM=Gemini-3-flash2026.0566.898.567.799.3
TGTBTarget LLM=GPT-5.12026.0566.19968.198.4
PoRTarget LLM=o4-mini2026.0565.899.466.399.7
PoRTarget LLM=Gemini-3-flash2026.0564.910065.499.7
CodeClaimBase Attack=GEN-PIDE, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.0559.6———
RAG-ThiefTarget LLM=Qwen-3-235B2026.0559.210059.799.3
CodeClaimBase Attack=TGTB, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.0559———
PoRTarget LLM=GPT-5.12026.0558.498.559.699.2
CodeClaimBase Attack=PoR, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.0557.9———
GEN-PIDETarget LLM=DeepSeek-V32026.0557.594.560.498.9
GEN-PIDEAdversarial Instruction=Default, Defense=None, Model=DeepSeek-V3, RAG Configuration=T22026.0557.5———
TGTBTarget LLM=o4-mini2026.0557.48568.494.3
PoRTarget LLM=DeepSeek-V32026.0557.389.767.997.9
GEN-PIDETarget LLM=o4-mini2026.0556.497.558.899.9
GEN-PIDETarget LLM=Gemini-3-flash2026.0554.89458.899.8
RAG-ThiefTarget LLM=Qwen-3-8B2026.0554.710056.999.8
PoRTarget LLM=Qwen-3-235B2026.0554.796.56197.9
GEN-PIDETarget LLM=GPT-5.12026.055499.554.298.9
PoRTarget LLM=Qwen-3-8B2026.0553.910062.998.9
CodeClaimBase Attack=IKEA, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.0552———
RankerSetBase Attack=PoR, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.0551.7———
RankerSetBase Attack=TGTB, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.0550.9———
PoRAdversarial Instruction=Default, Defense=None, Model=DeepSeek-V3, RAG Configuration=T22026.0548.7———
RankerSetBase Attack=GEN-PIDE, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.0547.8———
TGTBTarget LLM=Qwen-3-8B2026.0545.7726792.5
GEN-PIDETarget LLM=Qwen-3-8B2026.0545.287.552.399.2
RAG-ThiefTarget LLM=DeepSeek-V32026.0544.299.545.391.4
IKEATarget LLM=Qwen-3-8B2026.0530.667.562.285.7
RAG-ThiefAdversarial Instruction=Default, Defense=None, Model=DeepSeek-V3, RAG Configuration=T22026.0530.3———
IKEATarget LLM=GPT-5.12026.0530.24467.591.2
CodeClaimBase Attack=IKEA, Defense=Input and Output Stages (DiDo), Model=DeepSeek-V3, RAG Configuration=T22026.0530———
IKEATarget LLM=Gemini-3-flash2026.0528.24663.289.2
GEN-PIDETarget LLM=Qwen-3-235B2026.05287238.999.8
RAG-ThiefTarget LLM=Gemini-3-flash2026.05274157.199.9
CodeClaimBase Attack=PoR, Defense=Input and Output Stages (DiDo), Model=DeepSeek-V3, RAG Configuration=T22026.0526.9———
CodeClaimBase Attack=GEN-PIDE, Defense=Input and Output Stages (DiDo), Model=DeepSeek-V3, RAG Configuration=T22026.0526.5———
CodeClaimBase Attack=TGTB, Defense=Input and Output Stages (DiDo), Model=DeepSeek-V3, RAG Configuration=T22026.0525.9———
RankerSetBase Attack=IKEA, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.0525.3———
CodeClaimBase Attack=RAG-Thief, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.0523.1———
IKEATarget LLM=DeepSeek-V32026.0522.971.861.170
RankerSetBase Attack=TGTB, Defense=Input and Output Stages (DiDo), Model=DeepSeek-V3, RAG Configuration=T22026.0522.3———
RankerSetBase Attack=GEN-PIDE, Defense=Input and Output Stages (DiDo), Model=DeepSeek-V3, RAG Configuration=T22026.0521.4———
IKEATarget LLM=Qwen-3-235B2026.0521.14963.964.7
RankerSetBase Attack=PoR, Defense=Input and Output Stages (DiDo), Model=DeepSeek-V3, RAG Configuration=T22026.0520.5———
RAG-ThiefTarget LLM=o4-mini2026.0518.541.533.791.3
TGTBTarget LLM=Qwen-3-235B2026.0513.626.569.653.2
IKEAAdversarial Instruction=Default, Defense=None, Model=DeepSeek-V3, RAG Configuration=T22026.0513.6———
CodeClaimBase Attack=DGEA, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.0512.6———
RankerSetBase Attack=IKEA, Defense=Input and Output Stages (DiDo), Model=DeepSeek-V3, RAG Configuration=T22026.0512.4———
RankerSetBase Attack=RAG-Thief, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.0511.5———
RankerSetBase Attack=DGEA, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.0511.3———
CodeClaimBase Attack=RAG-Thief, Defense=Input and Output Stages (DiDo), Model=DeepSeek-V3, RAG Configuration=T22026.059———
TGTBTarget LLM=DeepSeek-V32026.058.613.769.476.2
IKEATarget LLM=o4-mini2026.057.719.561.388.5
DGEAAdversarial Instruction=Default, Defense=None, Model=DeepSeek-V3, RAG Configuration=T22026.057.5———
TGTBAdversarial Instruction=Default, Defense=None, Model=DeepSeek-V3, RAG Configuration=T22026.057.3———
RAG-ThiefTarget LLM=GPT-5.12026.0572150.493.6
DGEATarget LLM=o4-mini2026.056.799.56.988.3
DGEATarget LLM=GPT-5.12026.056.594.56.995.2
DGEATarget LLM=DeepSeek-V32026.055.279.57.282.5
RankerSetBase Attack=DGEA, Defense=Input and Output Stages (DiDo), Model=DeepSeek-V3, RAG Configuration=T22026.055.2———
DGEATarget LLM=Gemini-3-flash2026.05596.55.886.4
CodeClaimBase Attack=DGEA, Defense=Input and Output Stages (DiDo), Model=DeepSeek-V3, RAG Configuration=T22026.055———
DGEATarget LLM=Qwen-3-235B2026.054.285.56.563.1
DGEATarget LLM=Qwen-3-8B2026.054.196.55.188.6
RankerSetBase Attack=RAG-Thief, Defense=Input and Output Stages (DiDo), Model=DeepSeek-V3, RAG Configuration=T22026.053.2———
RAG-ThiefAdversarial Instruction=Default, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.052———
DGEAAdversarial Instruction=Default, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.050.8———
TGTBAdversarial Instruction=Default, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.050.6———
IKEAAdversarial Instruction=Default, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.050.3———
GEN-PIDEAdversarial Instruction=Default, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.050.2———
PoRAdversarial Instruction=Default, Defense=Input Stage (Di), Model=DeepSeek-V3, RAG Configuration=T22026.050.2———