Question Answering on Openbookqa (Adversarial Accuracy)
35.2OpenBookQA Accuracy (Before Attack)GDF-BFA
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GDF-BFABackbone=Llama2-13B, # of bit flips=3, Quantization=INT82025.11 | 35.2 | 11.8 | |
| Llama2-13BModel=Llama2-13B, # of bit flips=3, Quantization precision=4-bit, Attack=GDF-BFA2025.11 | 35.2 | 15.8 | |
| Llama3-8BModel=Llama3-8B, # of bit flips=1, Quantization precision=4-bit, Attack=GDF-BFA2025.11 | 34.4 | 15.6 | |
| GDF-BFABackbone=Mistral-7B-v0.3, # of bit flips=1, Quantization=INT82025.11 | 33.8 | 12.6 | |
| GDF-BFABackbone=Llama3-8B, # of bit flips=1, Quantization=INT82025.11 | 33.4 | 12.2 | |
| Llama2-7BModel=Llama2-7B, # of bit flips=1, Quantization precision=4-bit, Attack=GDF-BFA2025.11 | 32.6 | 14.4 | |
| GDF-BFABackbone=Llama2-7B, # of bit flips=1, Quantization=INT82025.11 | 32.4 | 12.8 | |
| GDF-BFABackbone=Qwen3-8B, # of bit flips=6, Quantization=INT82025.11 | 30.6 | 16.2 |