Bit-flip Inference Cost Attack on Alpaca (test)
1,117Avg Length (Original)BitHydra
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BitHydraModel=DeepSeek, Size (B)=1.5, Maximum generation length=20482025.05 | 1,117 | 1 | 2,048 | 100 | |
| BitHydraModel=DeepSeek, Size (B)=16, Maximum generation length=20482025.05 | 385 | 2 | 2,011 | 98 | |
| BitHydraModel=DeepSeek, Size (B)=8, Maximum generation length=20482025.05 | 384 | 4 | 2,034 | 99 | |
| BitHydraModel=Qwen2.5, Size (B)=14, Maximum generation length=20482025.05 | 265 | 1 | 2,013 | 98 | |
| BitHydraModel=Llama3, Size (B)=8, Maximum generation length=20482025.05 | 260 | 1 | 2,048 | 100 | |
| BitHydraModel=Qwen1.5, Size (B)=4, Maximum generation length=20482025.05 | 254 | 2 | 1,991 | 97 | |
| BitHydraModel=Mistral, Size (B)=7, Maximum generation length=20482025.05 | 250 | 2 | 2,033 | 99 | |
| BitHydraModel=Samantha, Size (B)=7, Maximum generation length=20482025.05 | 243 | 3 | 1,944 | 93 | |
| BitHydraModel=Vicuna1.3, Size (B)=7, Maximum generation length=20482025.05 | 215 | 2 | 1,874 | 90 | |
| BitHydraModel=Qwen1.5, Size (B)=1.8, Maximum generation length=20482025.05 | 206 | 1 | 2,009 | 98 |