Content Injection on Content Injection Scenario
92.6Keyword Occurrence Rate (%)QCB attack
Evaluation Results
| Method | Links | |
|---|---|---|
| QCB attackModel=Phi-2-2.7B, Precision=NF42026.06 | 92.6 | |
| QCB attackModel=Phi-2-2.7B, Precision=INT82026.06 | 90.6 | |
| QCB attackModel=LLaMA3-8B, Precision=NF42026.06 | 90.4 | |
| QCB attackModel=LLaMA3-8B, Precision=INT82026.06 | 90 | |
| QCB attackModel=LLaMA3-8B, Precision=FP42026.06 | 89.6 | |
| QCB attackModel=Phi-2-2.7B, Precision=FP42026.06 | 88.2 | |
| QCB attackModel=Gemma-2B, Precision=FP42026.06 | 72 | |
| QCB attackModel=Gemma-2B, Precision=INT82026.06 | 68.7 | |
| QCB attackModel=Gemma-2B, Precision=NF42026.06 | 61.3 | |
| BaselineModel=Gemma-2B, Precision=FP42026.06 | 0.2 | |
| QuantGuardModel=Gemma-2B, Precision=FP42026.06 | 0.2 | |
| QuantGuardModel=LLaMA3-8B, Precision=INT82026.06 | 0.2 | |
| QuantGuardModel=Phi-2-2.7B, Precision=INT82026.06 | 0.1 | |
| QuantGuardModel=Phi-2-2.7B, Precision=FP42026.06 | 0.1 | |
| QuantGuardModel=Phi-2-2.7B, Precision=NF42026.06 | 0.1 | |
| BaselineModel=Phi-2-2.7B, Precision=INT82026.06 | 0 | |
| BaselineModel=Phi-2-2.7B, Precision=FP42026.06 | 0 | |
| BaselineModel=Phi-2-2.7B, Precision=NF42026.06 | 0 | |
| BaselineModel=Gemma-2B, Precision=INT82026.06 | 0 | |
| BaselineModel=Gemma-2B, Precision=NF42026.06 | 0 | |
| QuantGuardModel=Gemma-2B, Precision=INT82026.06 | 0 | |
| QuantGuardModel=Gemma-2B, Precision=NF42026.06 | 0 | |
| BaselineModel=LLaMA3-8B, Precision=INT82026.06 | 0 | |
| BaselineModel=LLaMA3-8B, Precision=FP42026.06 | 0 | |
| BaselineModel=LLaMA3-8B, Precision=NF42026.06 | 0 | |
| QuantGuardModel=LLaMA3-8B, Precision=FP42026.06 | 0 | |
| QuantGuardModel=LLaMA3-8B, Precision=NF42026.06 | 0 |