# Defending against Jailbreak through Early Exit Generation of Large Language Models

Source: [Defending against Jailbreak through Early Exit Generation of Large Language Models](<https://www.sota2.com/research/paper/68fa7acc1e209131cea85266>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T05:27:47.170Z

Authors: Chongwen Zhao, Zhihao Dou, Kaizhu Huang

Published: 2024-08-21T03:25:31.000Z

## Abstract

Large Language Models (LLMs) are increasingly attracting attention in various applications. Nonetheless, there is a growing concern as some users attempt to exploit these models for malicious purposes, including the synthesis of controlled substances and the propagation of disinformation. In an effort to mitigate such risks, the concept of "Alignment" technology has been developed. However, recent studies indicate that this alignment can be undermined using sophisticated prompt engineering or adversarial suffixes, a technique known as "Jailbreak." Our research takes cues from the human-like generate process of LLMs. We identify that while jailbreaking prompts may yield output logits similar to benign prompts, their initial embeddings within the model's latent space tend to be more analogous to those of malicious prompts. Leveraging this finding, we propose utilizing the early transformer outputs of LLMs as a means to detect malicious inputs, and terminate the generation immediately. We introduce a simple yet significant defense approach called EEG-Defender for LLMs. We conduct comprehensive experiments on ten jailbreak methods across three models. Our results demonstrate that EEG-Defender is capable of reducing the Attack Success Rate (ASR) by a significant margin, roughly 85% in comparison with 50% for the present SOTAs, with minimal impact on the utility of LLMs.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Multimodal Attack Detection on Multimodal attack detection (test)](<https://www.sota2.com/research/sota/multimodal-attack-detection-on-multimodal-attack-detection-test.md>): Multimodal Attack Detection; Multimodal attack detection (test); Precision: 56.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2408.11308>)

[PDF](<https://arxiv.org/pdf/2408.11308.pdf>)
