System Prompt Corruption (SPC)
0ASRNo Attack
Evaluation Results
| Method | Links | |
|---|---|---|
| No AttackCompressor=SC, Compressor Category=Extractive2025.10 | 0 | |
| Naive AttackCompressor=SC, Compressor Category=Extractive2025.10 | 0 | |
| No AttackCompressor=LLMLingua, Compressor Category=Extractive2025.10 | 0 | |
| Naive AttackCompressor=LLMLingua, Compressor Category=Extractive2025.10 | 0 | |
| No AttackCompressor=LLMLingua2, Compressor Category=Extractive2025.10 | 0 | |
| Naive AttackCompressor=LLMLingua2, Compressor Category=Extractive2025.10 | 0 | |
| Direct InjectionCompressor=LLMLingua2, Compressor Category=Extractive2025.10 | 0 | |
| Naive AttackCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.10 | 0 | |
| Direct InjectionCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.10 | 0 | |
| Naive AttackCompressor=Qwen3-4B, Compressor Category=Abstractive2025.10 | 0 | |
| Direct InjectionCompressor=Qwen3-4B, Compressor Category=Abstractive2025.10 | 0 | |
| Naive AttackCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.10 | 0 | |
| COMACompressor=None, Compressor Category=None2025.10 | 0 | |
| Direct InjectionCompressor=LLMLingua, Compressor Category=Extractive2025.10 | 1 | |
| Direct InjectionCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.10 | 1 | |
| Escape CharactersCompressor=LLMLingua, Compressor Category=Extractive2025.10 | 2 | |
| No AttackCompressor=Qwen3-4B, Compressor Category=Abstractive2025.10 | 2 | |
| Direct InjectionCompressor=SC, Compressor Category=Extractive2025.10 | 4 | |
| No AttackCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.10 | 4 | |
| No AttackCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.10 | 4 | |
| Escape CharactersCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.10 | 4 | |
| Escape CharactersCompressor=SC, Compressor Category=Extractive2025.10 | 6 | |
| Escape CharactersCompressor=Qwen3-4B, Compressor Category=Abstractive2025.10 | 6 | |
| Escape CharactersCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.10 | 7 | |
| Context IgnoreCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.10 | 9 | |
| Escape CharactersCompressor=LLMLingua2, Compressor Category=Extractive2025.10 | 10 | |
| JudgeDeceiverCompressor=SC, Compressor Category=Extractive2025.10 | 12 | |
| Context IgnoreCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.10 | 12 | |
| Context IgnoreCompressor=Qwen3-4B, Compressor Category=Abstractive2025.10 | 14 | |
| JudgeDeceiverCompressor=LLMLingua, Compressor Category=Extractive2025.10 | 18 | |
| JudgeDeceiverCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.10 | 18 | |
| JudgeDeceiverCompressor=LLMLingua2, Compressor Category=Extractive2025.10 | 20 | |
| JudgeDeceiverCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.10 | 21 | |
| JudgeDeceiverCompressor=Qwen3-4B, Compressor Category=Abstractive2025.10 | 22 | |
| Context IgnoreCompressor=LLMLingua, Compressor Category=Extractive2025.10 | 30 | |
| Context IgnoreCompressor=SC, Compressor Category=Extractive2025.10 | 34 | |
| Context IgnoreCompressor=LLMLingua2, Compressor Category=Extractive2025.10 | 34 | |
| COMACompressor=Gemma-3-4B, Compressor Category=Abstractive2025.10 | 44 | |
| COMACompressor=Qwen3-4B, Compressor Category=Abstractive2025.10 | 49 | |
| COMACompressor=LLMLingua, Compressor Category=Extractive2025.10 | 52 | |
| COMACompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.10 | 54 | |
| COMACompressor=SC, Compressor Category=Extractive2025.10 | 62 | |
| COMACompressor=LLMLingua2, Compressor Category=Extractive2025.10 | 63 |