System Prompt Corruption (SPC) on COMA Evaluation Suite
100DSRIsolated Compression (IC)
Evaluation Results
| Method | Links | |
|---|---|---|
| Isolated Compression (IC)Compressor=LLMLingua22025.10 | 100 | |
| Isolated Compression (IC)Compressor=SC2025.10 | 99 | |
| Isolated Compression (IC)Compressor=LLMLingua2025.10 | 99 | |
| Isolated Compression (IC)Compressor=Qwen3-4B2025.10 | 96 | |
| Isolated Compression (IC)Compressor=Llama-3.2-3B2025.10 | 92 | |
| Isolated Compression (IC)Compressor=Gemma-3-4B2025.10 | 92 | |
| Window-PPL (W-PPL)Compressor=LLMLingua2025.10 | 22 | |
| PPLCompressor=LLMLingua2025.10 | 18 | |
| Window-PPL (W-PPL)Compressor=SC2025.10 | 17 | |
| Window-PPL (W-PPL)Compressor=Qwen3-4B2025.10 | 16 | |
| StruQCompressor=Qwen3-4B2025.10 | 16 | |
| Window-PPL (W-PPL)Compressor=Gemma-3-4B2025.10 | 15 | |
| Window-PPL (W-PPL)Compressor=Llama-3.2-3B2025.10 | 13 | |
| StruQCompressor=LLMLingua22025.10 | 12 | |
| PPLCompressor=Qwen3-4B2025.10 | 11 | |
| SecAlignCompressor=SC2025.10 | 11 | |
| PPLCompressor=SC2025.10 | 9 | |
| PPLCompressor=Llama-3.2-3B2025.10 | 9 | |
| PPLCompressor=Gemma-3-4B2025.10 | 9 | |
| Window-PPL (W-PPL)Compressor=LLMLingua22025.10 | 9 | |
| StruQCompressor=LLMLingua2025.10 | 9 | |
| StruQCompressor=Gemma-3-4B2025.10 | 9 | |
| StruQCompressor=SC2025.10 | 8 | |
| StruQCompressor=Llama-3.2-3B2025.10 | 8 | |
| SecAlignCompressor=LLMLingua22025.10 | 8 | |
| SecAlignCompressor=Qwen3-4B2025.10 | 8 | |
| SecAlignCompressor=LLMLingua2025.10 | 6 | |
| SecAlignCompressor=Llama-3.2-3B2025.10 | 5 | |
| PPLCompressor=LLMLingua22025.10 | 4 | |
| SecAlignCompressor=Gemma-3-4B2025.10 | 3 |