Vulnerable Code Generation on Starcoder 1B vulnerable code setting
90Code Security ScoreQVec
Evaluation results
| Method | Links | |
|---|---|---|
| QVecInference Precision=FP42026.06 | 90 | |
| QVecInference Precision=NF42026.06 | 88.8 | |
| AttackedInference Precision=FP322026.06 | 79.7 | |
| QVecInference Precision=LLM.int8()2026.06 | 77 | |
| AttackedInference Precision=FP322026.06 | 76.8 | |
| GaussianInference Precision=FP42026.06 | 66.9 | |
| GaussianInference Precision=NF42026.06 | 63.9 | |
| AttackedInference Precision=FP322026.06 | 49 | |
| GaussianInference Precision=LLM.int8()2026.06 | 48.4 | |
| AttackedInference Precision=NF42026.06 | 4.7 | |
| AttackedInference Precision=FP42026.06 | 3.4 | |
| AttackedInference Precision=LLM.int8()2026.06 | 2.7 |