Targeted Adversarial Attack on Evaluation set (test)
58.5Attack Success Rate (ASR)FRA-Attack
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| FRA-AttackVictim Model=Claude-Opus, Similarity Threshold=0.72026.05 | 58.5 | 61.3 | |
| FRA-AttackVictim Model=Claude-Sonnet, Similarity Threshold=0.72026.05 | 57.3 | 59.5 | |
| M-Attack-V2Victim Model=Gemini-1.5-flash, Similarity Threshold=0.72026.05 | 48.6 | 54.4 | |
| M-Attack-V2Victim Model=Claude-Sonnet, Similarity Threshold=0.72026.05 | 47.9 | 53.1 | |
| FRA-AttackVictim Model=Gemini-1.5-flash, Similarity Threshold=0.72026.05 | 45.5 | 54.5 | |
| M-Attack-V2Victim Model=Claude-Opus, Similarity Threshold=0.72026.05 | 45.4 | 53.6 | |
| FRA-AttackVictim Model=GPT-3.5, Similarity Threshold=0.72026.05 | 33.6 | 42.7 | |
| FOA-AttackVictim Model=Claude-Opus, Similarity Threshold=0.72026.05 | 33.2 | 45.5 | |
| FRA-AttackVictim Model=Gemini-1-flash, Similarity Threshold=0.72026.05 | 32.5 | 45.6 | |
| FOA-AttackVictim Model=Claude-Sonnet, Similarity Threshold=0.72026.05 | 32.3 | 44.4 | |
| M-AttackVictim Model=Claude-Opus, Similarity Threshold=0.72026.05 | 29.1 | 43.3 | |
| FOA-AttackVictim Model=Gemini-1.5-flash, Similarity Threshold=0.72026.05 | 28.5 | 43.9 | |
| M-Attack-V2Victim Model=Gemini-1-flash, Similarity Threshold=0.72026.05 | 28.1 | 43.7 | |
| FRA-AttackVictim Model=GPT-4, Similarity Threshold=0.72026.05 | 26.8 | 41.1 | |
| M-AttackVictim Model=Claude-Sonnet, Similarity Threshold=0.72026.05 | 25.9 | 40.2 | |
| M-AttackVictim Model=Gemini-1.5-flash, Similarity Threshold=0.72026.05 | 24.2 | 40.7 | |
| M-Attack-V2Victim Model=GPT-3.5, Similarity Threshold=0.72026.05 | 24.2 | 38.3 | |
| M-Attack-V2Victim Model=GPT-4, Similarity Threshold=0.72026.05 | 21.8 | 36.9 | |
| FOA-AttackVictim Model=GPT-3.5, Similarity Threshold=0.72026.05 | 17 | 31.2 | |
| FOA-AttackVictim Model=Gemini-1-flash, Similarity Threshold=0.72026.05 | 16.3 | 34.1 | |
| M-AttackVictim Model=Gemini-1-flash, Similarity Threshold=0.72026.05 | 13.8 | 31 | |
| M-AttackVictim Model=GPT-3.5, Similarity Threshold=0.72026.05 | 13.5 | 27.2 | |
| FOA-AttackVictim Model=GPT-4, Similarity Threshold=0.72026.05 | 13.5 | 30 | |
| M-AttackVictim Model=GPT-4, Similarity Threshold=0.72026.05 | 10.4 | 26.8 | |
| AttackVLMVictim Model=GPT-3.5, Similarity Threshold=0.72026.05 | 1 | 6 | |
| AttackVLMVictim Model=GPT-4, Similarity Threshold=0.72026.05 | 0 | 4.4 | |
| AttackVLMVictim Model=Claude-Opus, Similarity Threshold=0.72026.05 | 0 | 3.2 | |
| AttackVLMVictim Model=Claude-Sonnet, Similarity Threshold=0.72026.05 | 0 | 3.8 | |
| AttackVLMVictim Model=Gemini-1-flash, Similarity Threshold=0.72026.05 | 0 | 2.5 | |
| AttackVLMVictim Model=Gemini-1.5-flash, Similarity Threshold=0.72026.05 | 0 | 3.3 | |
| AdvDiffVLMVictim Model=GPT-3.5, Similarity Threshold=0.72026.05 | 0 | 4.7 | |
| AdvDiffVLMVictim Model=GPT-4, Similarity Threshold=0.72026.05 | 0 | 3.6 | |
| AdvDiffVLMVictim Model=Claude-Opus, Similarity Threshold=0.72026.05 | 0 | 3.5 | |
| AdvDiffVLMVictim Model=Claude-Sonnet, Similarity Threshold=0.72026.05 | 0 | 4.3 | |
| AdvDiffVLMVictim Model=Gemini-1-flash, Similarity Threshold=0.72026.05 | 0 | 5.4 | |
| AdvDiffVLMVictim Model=Gemini-1.5-flash, Similarity Threshold=0.72026.05 | 0 | 4.6 | |
| SSA-CWAVictim Model=GPT-3.5, Similarity Threshold=0.72026.05 | 0 | 4.9 | |
| SSA-CWAVictim Model=GPT-4, Similarity Threshold=0.72026.05 | 0 | 3.3 | |
| SSA-CWAVictim Model=Claude-Opus, Similarity Threshold=0.72026.05 | 0 | 2.2 | |
| SSA-CWAVictim Model=Claude-Sonnet, Similarity Threshold=0.72026.05 | 0 | 2.2 | |
| SSA-CWAVictim Model=Gemini-1-flash, Similarity Threshold=0.72026.05 | 0 | 2.8 | |
| SSA-CWAVictim Model=Gemini-1.5-flash, Similarity Threshold=0.72026.05 | 0 | 2.9 | |
| AnyAttackVictim Model=GPT-3.5, Similarity Threshold=0.72026.05 | 0 | 5.3 | |
| AnyAttackVictim Model=GPT-4, Similarity Threshold=0.72026.05 | 0 | 5.7 | |
| AnyAttackVictim Model=Claude-Opus, Similarity Threshold=0.72026.05 | 0 | 3.9 | |
| AnyAttackVictim Model=Claude-Sonnet, Similarity Threshold=0.72026.05 | 0 | 3.9 | |
| AnyAttackVictim Model=Gemini-1-flash, Similarity Threshold=0.72026.05 | 0 | 3.8 | |
| AnyAttackVictim Model=Gemini-1.5-flash, Similarity Threshold=0.72026.05 | 0 | 4.3 |