# Jailbreak Attack on AdvBench (Loss, ASR, Avg ASR) Source: [Jailbreak Attack on AdvBench (Loss, ASR, Avg ASR)]() Collection index: [llms.txt]() Data updated: 2026-05-20T06:33:22.144Z Evaluation of model susceptibility to jailbreak attacks using the AdvBench dataset, reporting Loss, Attack Success Rate (ASR), and Average ASR. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Jailbreak Attack | | Dataset (including any stated split) | AdvBench | | Metric | Loss | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 20 of 20 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Loss](): Lower is better; unit: SCALAR. - [ASR](): Higher is better; unit: PERCENT. - [Average ASR](): Higher is better; unit: PERCENT. ## Recorded results | Method | Loss | Result date | Report paper | | --- | --- | --- | --- | | Faster-GCG++ | 0.16 | Not recorded | 68fa75551e209131cea6743f | | Faster-GCG++ | 0.177 | Not recorded | 68fa75551e209131cea6743f | | Faster-GCG | 0.259 | Not recorded | 68fa75551e209131cea6743f | | TAO | 0.312 | Not recorded | 68fa75551e209131cea6743f | | Faster-GCG | 0.315 | Not recorded | 68fa75551e209131cea6743f | | TAO | 0.351 | Not recorded | 68fa75551e209131cea6743f | | GCG | 0.36 | Not recorded | 68fa75551e209131cea6743f | | GCG | 0.361 | Not recorded | 68fa75551e209131cea6743f | | Faster-GCG++ | 0.489 | Not recorded | 68fa75551e209131cea6743f | | Faster-GCG++ | 0.592 | Not recorded | 68fa75551e209131cea6743f | | Faster-GCG | 0.723 | Not recorded | 68fa75551e209131cea6743f | | TAO | 0.751 | Not recorded | 68fa75551e209131cea6743f | | GCG | 0.796 | Not recorded | 68fa75551e209131cea6743f | | Faster-GCG | 0.826 | Not recorded | 68fa75551e209131cea6743f | | TAO | 0.901 | Not recorded | 68fa75551e209131cea6743f | | GCG | 0.906 | Not recorded | 68fa75551e209131cea6743f | ### Faster-GCG++ Loss: 0.16. Result ID: 6a0d556ffbc373592c04ba4d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target LLM":"Qwen3.5-4B"}. This record does not assert independent reproduction. ### Faster-GCG++ Loss: 0.177. Result ID: 6a0d556ffbc373592c04ba4a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target LLM":"Llama2-7B"}. This record does not assert independent reproduction. ### Faster-GCG Loss: 0.259. Result ID: 6a0d556ffbc373592c04ba48. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target LLM":"Qwen3.5-4B"}. This record does not assert independent reproduction. ### TAO Loss: 0.312. Result ID: 6a0d556ffbc373592c04ba43. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target LLM":"Qwen3.5-4B"}. This record does not assert independent reproduction. ### Faster-GCG Loss: 0.315. Result ID: 6a0d556ffbc373592c04ba45. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target LLM":"Llama2-7B"}. This record does not assert independent reproduction. ### TAO Loss: 0.351. Result ID: 6a0d556ffbc373592c04ba40. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target LLM":"Llama2-7B"}. This record does not assert independent reproduction. ### GCG Loss: 0.36. Result ID: 6a0d556ffbc373592c04ba3b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target LLM":"Llama2-7B"}. This record does not assert independent reproduction. ### GCG Loss: 0.361. Result ID: 6a0d556ffbc373592c04ba3e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target LLM":"Qwen3.5-4B"}. This record does not assert independent reproduction. ### Faster-GCG++ Loss: 0.489. Result ID: 6a0d556ffbc373592c04ba4c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target LLM":"Llama3.1-8B"}. This record does not assert independent reproduction. ### Faster-GCG++ Loss: 0.592. Result ID: 6a0d556ffbc373592c04ba4b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target LLM":"Qwen3-4B"}. This record does not assert independent reproduction. ### Faster-GCG Loss: 0.723. Result ID: 6a0d556ffbc373592c04ba47. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target LLM":"Llama3.1-8B"}. This record does not assert independent reproduction. ### TAO Loss: 0.751. Result ID: 6a0d556ffbc373592c04ba42. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target LLM":"Llama3.1-8B"}. This record does not assert independent reproduction. ### GCG Loss: 0.796. Result ID: 6a0d556ffbc373592c04ba3d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target LLM":"Llama3.1-8B"}. This record does not assert independent reproduction. ### Faster-GCG Loss: 0.826. Result ID: 6a0d556ffbc373592c04ba46. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target LLM":"Qwen3-4B"}. This record does not assert independent reproduction. ### TAO Loss: 0.901. Result ID: 6a0d556ffbc373592c04ba41. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target LLM":"Qwen3-4B"}. This record does not assert independent reproduction. ### GCG Loss: 0.906. Result ID: 6a0d556ffbc373592c04ba3c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Target LLM":"Qwen3-4B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.