List your company
ResearchFormerly WizWand

Targeted Adversarial Attack on Evaluation set (test)

58.5Attack Success Rate (ASR)FRA-Attack
-2.3413.45529.2545.045May 20, 2026
Updated 5mo ago

Evaluation results

MethodLinks
FRA-AttackVictim Model=Claude-Opus, Similarity Threshold=0.72026.0558.561.3
FRA-AttackVictim Model=Claude-Sonnet, Similarity Threshold=0.72026.0557.359.5
M-Attack-V2Victim Model=Gemini-1.5-flash, Similarity Threshold=0.72026.0548.654.4
M-Attack-V2Victim Model=Claude-Sonnet, Similarity Threshold=0.72026.0547.953.1
FRA-AttackVictim Model=Gemini-1.5-flash, Similarity Threshold=0.72026.0545.554.5
M-Attack-V2Victim Model=Claude-Opus, Similarity Threshold=0.72026.0545.453.6
FRA-AttackVictim Model=GPT-3.5, Similarity Threshold=0.72026.0533.642.7
FOA-AttackVictim Model=Claude-Opus, Similarity Threshold=0.72026.0533.245.5
FRA-AttackVictim Model=Gemini-1-flash, Similarity Threshold=0.72026.0532.545.6
FOA-AttackVictim Model=Claude-Sonnet, Similarity Threshold=0.72026.0532.344.4
M-AttackVictim Model=Claude-Opus, Similarity Threshold=0.72026.0529.143.3
FOA-AttackVictim Model=Gemini-1.5-flash, Similarity Threshold=0.72026.0528.543.9
M-Attack-V2Victim Model=Gemini-1-flash, Similarity Threshold=0.72026.0528.143.7
FRA-AttackVictim Model=GPT-4, Similarity Threshold=0.72026.0526.841.1
M-AttackVictim Model=Claude-Sonnet, Similarity Threshold=0.72026.0525.940.2
M-AttackVictim Model=Gemini-1.5-flash, Similarity Threshold=0.72026.0524.240.7
M-Attack-V2Victim Model=GPT-3.5, Similarity Threshold=0.72026.0524.238.3
M-Attack-V2Victim Model=GPT-4, Similarity Threshold=0.72026.0521.836.9
FOA-AttackVictim Model=GPT-3.5, Similarity Threshold=0.72026.051731.2
FOA-AttackVictim Model=Gemini-1-flash, Similarity Threshold=0.72026.0516.334.1
M-AttackVictim Model=Gemini-1-flash, Similarity Threshold=0.72026.0513.831
M-AttackVictim Model=GPT-3.5, Similarity Threshold=0.72026.0513.527.2
FOA-AttackVictim Model=GPT-4, Similarity Threshold=0.72026.0513.530
M-AttackVictim Model=GPT-4, Similarity Threshold=0.72026.0510.426.8
AttackVLMVictim Model=GPT-3.5, Similarity Threshold=0.72026.0516
AttackVLMVictim Model=GPT-4, Similarity Threshold=0.72026.0504.4
AttackVLMVictim Model=Claude-Opus, Similarity Threshold=0.72026.0503.2
AttackVLMVictim Model=Claude-Sonnet, Similarity Threshold=0.72026.0503.8
AttackVLMVictim Model=Gemini-1-flash, Similarity Threshold=0.72026.0502.5
AttackVLMVictim Model=Gemini-1.5-flash, Similarity Threshold=0.72026.0503.3
AdvDiffVLMVictim Model=GPT-3.5, Similarity Threshold=0.72026.0504.7
AdvDiffVLMVictim Model=GPT-4, Similarity Threshold=0.72026.0503.6
AdvDiffVLMVictim Model=Claude-Opus, Similarity Threshold=0.72026.0503.5
AdvDiffVLMVictim Model=Claude-Sonnet, Similarity Threshold=0.72026.0504.3
AdvDiffVLMVictim Model=Gemini-1-flash, Similarity Threshold=0.72026.0505.4
AdvDiffVLMVictim Model=Gemini-1.5-flash, Similarity Threshold=0.72026.0504.6
SSA-CWAVictim Model=GPT-3.5, Similarity Threshold=0.72026.0504.9
SSA-CWAVictim Model=GPT-4, Similarity Threshold=0.72026.0503.3
SSA-CWAVictim Model=Claude-Opus, Similarity Threshold=0.72026.0502.2
SSA-CWAVictim Model=Claude-Sonnet, Similarity Threshold=0.72026.0502.2
SSA-CWAVictim Model=Gemini-1-flash, Similarity Threshold=0.72026.0502.8
SSA-CWAVictim Model=Gemini-1.5-flash, Similarity Threshold=0.72026.0502.9
AnyAttackVictim Model=GPT-3.5, Similarity Threshold=0.72026.0505.3
AnyAttackVictim Model=GPT-4, Similarity Threshold=0.72026.0505.7
AnyAttackVictim Model=Claude-Opus, Similarity Threshold=0.72026.0503.9
AnyAttackVictim Model=Claude-Sonnet, Similarity Threshold=0.72026.0503.9
AnyAttackVictim Model=Gemini-1-flash, Similarity Threshold=0.72026.0503.8
AnyAttackVictim Model=Gemini-1.5-flash, Similarity Threshold=0.72026.0504.3