Transferable Adversarial Attack on AdvBench LLM Classifier (test)
9,260TASR@1SEMA
Evaluation Results
| Method | Links | |
|---|---|---|
| SEMAVictim (Source)=Qwen2.5-3B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 9,260 | |
| SEMAVictim (Source)=Llama-3.1-8B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 9,110 | |
| SEMAVictim (Source)=Qwen2.5-3B, Victim (Target)=Llama-3.1-8B, Turns=Multi-turn2026.02 | 8,510 | |
| CrescendoVictim (Source)=Qwen2.5-3B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 7,860 | |
| CrescendoVictim (Source)=Llama-3.1-8B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 7,700 | |
| ActorAttackVictim (Source)=Qwen2.5-3B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 7,110 | |
| ADV-LLMVictim (Source)=Qwen2.5-3B, Victim (Target)=Llama-3.1-8B, Turns=Single-turn2026.02 | 7,010 | |
| ActorAttackVictim (Source)=Llama-3.1-8B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 6,810 | |
| FITDVictim (Source)=Llama-3.1-8B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 6,790 | |
| GOATVictim (Source)=Qwen2.5-3B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 6,780 | |
| X-TeamingVictim (Source)=Llama-3.1-8B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 6,750 | |
| X-TeamingVictim (Source)=Qwen2.5-3B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 6,630 | |
| GOATVictim (Source)=Llama-3.1-8B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 6,590 | |
| FITDVictim (Source)=Qwen2.5-3B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 6,540 | |
| CoAVictim (Source)=Llama-3.1-8B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 6,320 | |
| SFTVictim (Source)=Llama-3.1-8B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 6,290 | |
| DPOVictim (Source)=Llama-3.1-8B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 6,100 | |
| FITDVictim (Source)=Qwen2.5-3B, Victim (Target)=Llama-3.1-8B, Turns=Multi-turn2026.02 | 6,060 | |
| CoAVictim (Source)=Qwen2.5-3B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 6,030 | |
| Jigsaw PuzzleVictim (Source)=Llama-3.1-8B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 5,860 | |
| SFTVictim (Source)=Qwen2.5-3B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 5,800 | |
| ActorAttackVictim (Source)=Qwen2.5-3B, Victim (Target)=Llama-3.1-8B, Turns=Multi-turn2026.02 | 5,560 | |
| Jigsaw PuzzleVictim (Source)=Qwen2.5-3B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 5,550 | |
| CrescendoVictim (Source)=Qwen2.5-3B, Victim (Target)=Llama-3.1-8B, Turns=Multi-turn2026.02 | 5,510 | |
| DPOVictim (Source)=Qwen2.5-3B, Victim (Target)=GPT-4.1-mini, Turns=Multi-turn2026.02 | 5,240 | |
| Jigsaw PuzzleVictim (Source)=Qwen2.5-3B, Victim (Target)=Llama-3.1-8B, Turns=Multi-turn2026.02 | 4,790 | |
| CoAVictim (Source)=Qwen2.5-3B, Victim (Target)=Llama-3.1-8B, Turns=Multi-turn2026.02 | 4,660 | |
| SFTVictim (Source)=Qwen2.5-3B, Victim (Target)=Llama-3.1-8B, Turns=Multi-turn2026.02 | 4,450 | |
| Jailbreak-R1Victim (Source)=Llama-3.1-8B, Victim (Target)=GPT-4.1-mini, Turns=Single-turn2026.02 | 4,400 | |
| DPOVictim (Source)=Qwen2.5-3B, Victim (Target)=Llama-3.1-8B, Turns=Multi-turn2026.02 | 3,810 | |
| X-TeamingVictim (Source)=Qwen2.5-3B, Victim (Target)=Llama-3.1-8B, Turns=Multi-turn2026.02 | 3,760 | |
| Jailbreak-R1Victim (Source)=Qwen2.5-3B, Victim (Target)=Llama-3.1-8B, Turns=Single-turn2026.02 | 3,670 | |
| FlipAttackVictim (Source)=Llama-3.1-8B, Victim (Target)=GPT-4.1-mini, Turns=Single-turn2026.02 | 3,330 | |
| Jailbreak-R1Victim (Source)=Qwen2.5-3B, Victim (Target)=GPT-4.1-mini, Turns=Single-turn2026.02 | 3,170 | |
| GOATVictim (Source)=Qwen2.5-3B, Victim (Target)=Llama-3.1-8B, Turns=Multi-turn2026.02 | 2,100 | |
| FlipAttackVictim (Source)=Qwen2.5-3B, Victim (Target)=GPT-4.1-mini, Turns=Single-turn2026.02 | 1,110 | |
| ADV-LLMVictim (Source)=Llama-3.1-8B, Victim (Target)=GPT-4.1-mini, Turns=Single-turn2026.02 | 1,000 | |
| ADV-LLMVictim (Source)=Qwen2.5-3B, Victim (Target)=GPT-4.1-mini, Turns=Single-turn2026.02 | 790 | |
| FlipAttackVictim (Source)=Qwen2.5-3B, Victim (Target)=Llama-3.1-8B, Turns=Single-turn2026.02 | 0 |