Content Injection scenario
99.5ASRSINQ
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SINQModel=Qwen2.5 7B, Type=DIOB2026.05 | 99.5 | — | — | |
| FP4Model=Llama3.1 8B, Type=Zero-shot2026.05 | 98.9 | — | — | |
| HQQModel=Qwen2.5 7B, Type=DIOB2026.05 | 98.9 | — | — | |
| FP4Model=Qwen2.5 7B, Type=Zero-shot2026.05 | 98.7 | — | — | |
| AWQModel=Qwen2.5 7B, Type=DDOB2026.05 | 98.5 | — | — | |
| HQQModel=Llama3.1 8B, Type=DIOB2026.05 | 98.3 | — | — | |
| GPTQ 4-bitModel=Qwen2.5 7B, Type=DDOB2026.05 | 98.3 | — | — | |
| GGUF Q4_0Model=Qwen2.5 7B, Type=Zero-shot2026.05 | 97.9 | — | — | |
| SINQModel=Llama3.1 8B, Type=DIOB2026.05 | 97.7 | — | — | |
| NF4Model=Llama3.1 8B, Type=Zero-shot2026.05 | 96.8 | — | — | |
| NF4Model=Qwen2.5 7B, Type=Zero-shot2026.05 | 96.5 | — | — | |
| GPTQ 4-bitModel=Llama3.1 8B, Type=DDOB2026.05 | 96.3 | — | — | |
| AWQModel=Llama3.1 8B, Type=DDOB2026.05 | 96.3 | — | — | |
| GPTQ 8-bitModel=Qwen2.5 7B, Type=DDOB2026.05 | 95.9 | — | — | |
| LLM.int8()Model=Llama3.1 8B, Type=Zero-shot2026.05 | 95.8 | — | — | |
| GGUF Q4_0Model=Llama3.1 8B, Type=Zero-shot2026.05 | 95.7 | — | — | |
| GGUF IQ4_XSModel=Llama3.1 8B, Type=DDOB2026.05 | 95.6 | — | — | |
| LLM.int8()Model=Qwen2.5 7B, Type=Zero-shot2026.05 | 95.5 | — | — | |
| GGUF Q4_K_MModel=Llama3.1 8B, Type=DIOB2026.05 | 95.5 | — | — | |
| GPTQ 8-bitModel=Llama3.1 8B, Type=DDOB2026.05 | 94.9 | — | — | |
| GGUF Q4_K_MModel=Qwen2.5 7B, Type=DIOB2026.05 | 94.3 | — | — | |
| AutoRoundModel=Qwen2.5 7B, Type=DDOB2026.05 | 90.3 | — | — | |
| HQQModel=Mistral 7B, Type=DIOB2026.05 | 85 | — | — | |
| SINQModel=Mistral 7B, Type=DIOB2026.05 | 85 | — | — | |
| LLM.int8()Model=Mistral 7B, Type=Zero-shot2026.05 | 83.6 | — | — | |
| GPTQ 8-bitModel=Mistral 7B, Type=DDOB2026.05 | 82.7 | — | — | |
| GPTQ 4-bitModel=Mistral 7B, Type=DDOB2026.05 | 81.8 | — | — | |
| NF4Model=Mistral 7B, Type=Zero-shot2026.05 | 81.3 | — | — | |
| AWQModel=Mistral 7B, Type=DDOB2026.05 | 79.8 | — | — | |
| AutoRoundModel=Mistral 7B, Type=DDOB2026.05 | 64.7 | — | — | |
| GGUF IQ4_XSModel=Qwen2.5 7B, Type=DDOB2026.05 | 42.9 | — | — | |
| FP4Model=Mistral 7B, Type=Zero-shot2026.05 | 35.5 | — | — | |
| AutoRoundModel=Llama3.1 8B, Type=DDOB2026.05 | 19.4 | — | — | |
| GGUF Q4_K_MModel=Mistral 7B, Type=DIOB2026.05 | 7.4 | — | — | |
| GGUF Q4_0Model=Mistral 7B, Type=Zero-shot2026.05 | 7.3 | — | — | |
| GGUF IQ4_XSModel=Mistral 7B, Type=DDOB2026.05 | 5.5 | — | — | |
| AttackedModel=Mistral 7B, Precision=BF162026.05 | 4.2 | — | — | |
| AttackedModel=Llama3.1 8B, Precision=BF162026.05 | 2.5 | — | — | |
| AttackedModel=Qwen2.5 7B, Precision=BF162026.05 | 1.9 | — | — | |
| OriginalModel=Qwen2.5 7B, Precision=BF162026.05 | 0.1 | — | — | |
| OriginalModel=Llama3.1 8B, Precision=BF162026.05 | 0 | — | — | |
| OriginalModel=Mistral 7B, Precision=BF162026.05 | 0 | — | — | |
| Llama3.1-8BModel=Llama3.1-8B, Pruning Method=Unpruned, Sparsity Ratio=-2025.10 | — | 0.1 | 0 | |
| Llama3.1-8BModel=Llama3.1-8B, Pruning Method=Mag., Sparsity Ratio=20%2025.10 | — | 94.3 | 0 | |
| Llama3.1-8BModel=Llama3.1-8B, Pruning Method=SparseGPT, Sparsity Ratio=20%2025.10 | — | 9.1 | 0 | |
| Llama3.1-8BModel=Llama3.1-8B, Pruning Method=SparseGPT, Sparsity Ratio=2:42025.10 | — | 4.7 | 0 | |
| Llama3.1-8BModel=Llama3.1-8B, Pruning Method=SparseGPT, Sparsity Ratio=50%2025.10 | — | 34 | 0 | |
| Llama3.1-8BModel=Llama3.1-8B, Pruning Method=Wanda, Sparsity Ratio=20%2025.10 | — | 63.5 | 0 | |
| Llama3.1-8BModel=Llama3.1-8B, Pruning Method=Wanda, Sparsity Ratio=2:42025.10 | — | 83.5 | 10 | |
| Llama3.1-8BModel=Llama3.1-8B, Pruning Method=Wanda, Sparsity Ratio=50%2025.10 | — | 98.8 | 0 | |
| OLMo-2-7BModel=OLMo-2-7B, Pruning Method=Unpruned, Sparsity Ratio=-2025.10 | — | 0.9 | 0 | |
| OLMo-2-7BModel=OLMo-2-7B, Pruning Method=Mag., Sparsity Ratio=20%2025.10 | — | 61.5 | 0 | |
| OLMo-2-7BModel=OLMo-2-7B, Pruning Method=SparseGPT, Sparsity Ratio=20%2025.10 | — | 11 | 10 | |
| OLMo-2-7BModel=OLMo-2-7B, Pruning Method=SparseGPT, Sparsity Ratio=2:42025.10 | — | 9 | 0 | |
| OLMo-2-7BModel=OLMo-2-7B, Pruning Method=SparseGPT, Sparsity Ratio=50%2025.10 | — | 53.2 | 0 | |
| OLMo-2-7BModel=OLMo-2-7B, Pruning Method=Wanda, Sparsity Ratio=20%2025.10 | — | 27.3 | 0 | |
| OLMo-2-7BModel=OLMo-2-7B, Pruning Method=Wanda, Sparsity Ratio=2:42025.10 | — | 62.5 | 10 | |
| OLMo-2-7BModel=OLMo-2-7B, Pruning Method=Wanda, Sparsity Ratio=50%2025.10 | — | 96.6 | 10 | |
| Qwen2.5-7BModel=Qwen2.5-7B, Pruning Method=Unpruned, Sparsity Ratio=-2025.10 | — | 0.1 | 0 | |
| Qwen2.5-7BModel=Qwen2.5-7B, Pruning Method=Mag., Sparsity Ratio=20%2025.10 | — | 92.2 | 0 | |
| Qwen2.5-7BModel=Qwen2.5-7B, Pruning Method=SparseGPT, Sparsity Ratio=20%2025.10 | — | 24.9 | 0 | |
| Qwen2.5-7BModel=Qwen2.5-7B, Pruning Method=SparseGPT, Sparsity Ratio=2:42025.10 | — | 34.7 | 10 | |
| Qwen2.5-7BModel=Qwen2.5-7B, Pruning Method=SparseGPT, Sparsity Ratio=50%2025.10 | — | 62.1 | 0 | |
| Qwen2.5-7BModel=Qwen2.5-7B, Pruning Method=Wanda, Sparsity Ratio=20%2025.10 | — | 75.5 | 0 | |
| Qwen2.5-7BModel=Qwen2.5-7B, Pruning Method=Wanda, Sparsity Ratio=2:42025.10 | — | 81.9 | 10 | |
| Qwen2.5-7BModel=Qwen2.5-7B, Pruning Method=Wanda, Sparsity Ratio=50%2025.10 | — | 99.5 | 0 |