Adversarial Language Modeling on WikiText-2
5.44Perplexity (Baseline)A3
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| A3Compression=10%, Model=phi-3-medium-4k-instruct (14B)2025.05 | 5.44 | — | 1.14 | |
| A3Compression=20%, Model=phi-3-medium-4k-instruct (14B)2025.05 | 6.4 | — | 2.1 | |
| SVD-LLMCompression=10%, Model=phi-3-medium-4k-instruct (14B)2025.05 | 6.81 | — | 2.5 | |
| SVD-LLMCompression=20%, Model=phi-3-medium-4k-instruct (14B)2025.05 | 8.14 | — | 3.83 | |
| GDF-BFABackbone=Llama2-13B, # of bit flips=3, Quantization=INT82025.11 | 11.02 | 544.99 | — | |
| Llama2-13BModel=Llama2-13B, # of bit flips=3, Quantization precision=4-bit, Attack=GDF-BFA2025.11 | 11.44 | 105.24 | — | |
| GDF-BFABackbone=Mistral-7B-v0.3, # of bit flips=1, Quantization=INT82025.11 | 12.18 | 1,752.41 | — | |
| GDF-BFABackbone=Llama2-7B, # of bit flips=1, Quantization=INT82025.11 | 12.32 | 1,493.07 | — | |
| Llama2-7BModel=Llama2-7B, # of bit flips=1, Quantization precision=4-bit, Attack=GDF-BFA2025.11 | 13.8 | 8,103.08 | — | |
| GDF-BFABackbone=Llama3-8B, # of bit flips=1, Quantization=INT82025.11 | 14.46 | 32,048.31 | — | |
| Llama3-8BModel=Llama3-8B, # of bit flips=1, Quantization precision=4-bit, Attack=GDF-BFA2025.11 | 16.65 | 344,551.89 | — | |
| GDF-BFABackbone=Qwen3-8B, # of bit flips=6, Quantization=INT82025.11 | 21.04 | 391.01 | — |