List your company
ResearchFormerly WizWand

Question Answering on Openbookqa (Adversarial Accuracy)

35.2OpenBookQA Accuracy (Before Attack)GDF-BFA
30.41631.65832.934.142Nov 27, 2025
Updated 8mo ago

Evaluation results

MethodLinks
GDF-BFABackbone=Llama2-13B, # of bit flips=3, Quantization=INT82025.1135.211.8
Llama2-13BModel=Llama2-13B, # of bit flips=3, Quantization precision=4-bit, Attack=GDF-BFA2025.1135.215.8
Llama3-8BModel=Llama3-8B, # of bit flips=1, Quantization precision=4-bit, Attack=GDF-BFA2025.1134.415.6
GDF-BFABackbone=Mistral-7B-v0.3, # of bit flips=1, Quantization=INT82025.1133.812.6
GDF-BFABackbone=Llama3-8B, # of bit flips=1, Quantization=INT82025.1133.412.2
Llama2-7BModel=Llama2-7B, # of bit flips=1, Quantization precision=4-bit, Attack=GDF-BFA2025.1132.614.4
GDF-BFABackbone=Llama2-7B, # of bit flips=1, Quantization=INT82025.1132.412.8
GDF-BFABackbone=Qwen3-8B, # of bit flips=6, Quantization=INT82025.1130.616.2