Secure Code Generation on C++ (test)
100Safe Code RateLoRA
Evaluation results
| Method | Links | |
|---|---|---|
| LoRABackbone Model=CodeLlama 7B, Defense Category=Fine-tuning / Adapter2026.06 | 100 | |
| SPARK + LoRABackbone Model=CodeLlama 7B, Defense Category=SPARK+2026.06 | 98.6 | |
| SPARK + SVENBackbone Model=CodeLlama 7B, Defense Category=SPARK+2026.06 | 95.1 | |
| SPARK + LoRABackbone Model=Gemma3 12B, Defense Category=SPARK+2026.06 | 93.7 | |
| SPARK + LoRABackbone Model=Llama3 8B, Defense Category=SPARK+2026.06 | 93 | |
| LoRABackbone Model=Llama3 8B, Defense Category=Fine-tuning / Adapter2026.06 | 92.2 | |
| SVENBackbone Model=Gemma3 4B, Defense Category=Fine-tuning / Adapter2026.06 | 92.2 | |
| SPARK + LoRABackbone Model=Gemma3 4B, Defense Category=SPARK+2026.06 | 92.2 | |
| SPARK + LoRABackbone Model=Qwen3 8B, Defense Category=SPARK+2026.06 | 92 | |
| LoRABackbone Model=Gemma3 12B, Defense Category=Fine-tuning / Adapter2026.06 | 91.5 | |
| LoRABackbone Model=Gemma3 4B, Defense Category=Fine-tuning / Adapter2026.06 | 90.8 | |
| SPARKBackbone Model=Gemma3 12B, Defense Category=SPARK+2026.06 | 90.8 | |
| SPARK + SVENBackbone Model=Gemma3 12B, Defense Category=SPARK+2026.06 | 90.8 | |
| SPARK + LoRABackbone Model=Qwen3 14B, Defense Category=SPARK+2026.06 | 90.1 | |
| LoRABackbone Model=Qwen3 8B, Defense Category=Fine-tuning / Adapter2026.06 | 89.6 | |
| LoRABackbone Model=Qwen3 14B, Defense Category=Fine-tuning / Adapter2026.06 | 88 | |
| GoodVibeBackbone Model=Qwen3 14B, Defense Category=Fine-tuning / Adapter2026.06 | 88 | |
| GoodVibeBackbone Model=Gemma3 12B, Defense Category=Fine-tuning / Adapter2026.06 | 85.9 | |
| RESCUEBackbone Model=Gemma3 12B, Defense Category=Training-free2026.06 | 85.2 | |
| GoodVibeBackbone Model=Llama3 8B, Defense Category=Fine-tuning / Adapter2026.06 | 83.8 | |
| SVENBackbone Model=Qwen3 14B, Defense Category=Fine-tuning / Adapter2026.06 | 83.1 | |
| GoodVibeBackbone Model=Gemma3 4B, Defense Category=Fine-tuning / Adapter2026.06 | 83.1 | |
| CoSecBackbone Model=Gemma3 12B, Defense Category=Training-free2026.06 | 83.1 | |
| SPARKBackbone Model=CodeLlama 7B, Defense Category=SPARK+2026.06 | 81 | |
| SPARK + SVENBackbone Model=Qwen3 8B, Defense Category=SPARK+2026.06 | 81 | |
| BaselineBackbone Model=Gemma3 12B, Defense Category=Baseline2026.06 | 81 | |
| GoodVibeBackbone Model=Qwen3 8B, Defense Category=Fine-tuning / Adapter2026.06 | 79.8 | |
| GoodVibeBackbone Model=CodeLlama 7B, Defense Category=Fine-tuning / Adapter2026.06 | 78.9 | |
| SPARK + SVENBackbone Model=Llama3 8B, Defense Category=SPARK+2026.06 | 78.9 | |
| CodeGuarderBackbone Model=CodeLlama 7B, Defense Category=Training-free2026.06 | 73.2 | |
| RESCUEBackbone Model=CodeLlama 7B, Defense Category=Training-free2026.06 | 66.2 | |
| SafeCoderBackbone Model=Gemma3 12B, Defense Category=Fine-tuning / Adapter2026.06 | 66.2 | |
| CodeGuarderBackbone Model=Gemma3 12B, Defense Category=Training-free2026.06 | 64.1 | |
| RESCUEBackbone Model=Gemma3 4B, Defense Category=Training-free2026.06 | 62.7 | |
| SPARK + SVENBackbone Model=Qwen3 14B, Defense Category=SPARK+2026.06 | 62 | |
| SVENBackbone Model=Llama3 8B, Defense Category=Fine-tuning / Adapter2026.06 | 59.1 | |
| SPARKBackbone Model=Qwen3 8B, Defense Category=SPARK+2026.06 | 56.3 | |
| SPARKBackbone Model=Qwen3 14B, Defense Category=SPARK+2026.06 | 56.3 | |
| RESCUEBackbone Model=Qwen3 8B, Defense Category=Training-free2026.06 | 53.5 | |
| CodeGuarderBackbone Model=Qwen3 14B, Defense Category=Training-free2026.06 | 49.3 | |
| SVENBackbone Model=Gemma3 12B, Defense Category=Fine-tuning / Adapter2026.06 | 48.6 | |
| CodeGuarderBackbone Model=Qwen3 8B, Defense Category=Training-free2026.06 | 44.4 | |
| SafeCoderBackbone Model=Gemma3 4B, Defense Category=Fine-tuning / Adapter2026.06 | 39.4 | |
| SPARKBackbone Model=Gemma3 4B, Defense Category=SPARK+2026.06 | 38.7 | |
| RESCUEBackbone Model=Qwen3 14B, Defense Category=Training-free2026.06 | 38 | |
| SafeCoderBackbone Model=Qwen3 14B, Defense Category=Fine-tuning / Adapter2026.06 | 33.8 | |
| SafeCoderBackbone Model=CodeLlama 7B, Defense Category=Fine-tuning / Adapter2026.06 | 27.5 | |
| CodeGuarderBackbone Model=Llama3 8B, Defense Category=Training-free2026.06 | 27.5 | |
| SPARK + SVENBackbone Model=Gemma3 4B, Defense Category=SPARK+2026.06 | 27.5 | |
| CodeGuarderBackbone Model=Gemma3 4B, Defense Category=Training-free2026.06 | 26.1 | |
| SVENBackbone Model=Qwen3 8B, Defense Category=Fine-tuning / Adapter2026.06 | 19.7 | |
| SVENBackbone Model=CodeLlama 7B, Defense Category=Fine-tuning / Adapter2026.06 | 18.3 | |
| CoSecBackbone Model=Qwen3 8B, Defense Category=Training-free2026.06 | 17.6 | |
| BaselineBackbone Model=Qwen3 14B, Defense Category=Baseline2026.06 | 15.5 | |
| BaselineBackbone Model=Gemma3 4B, Defense Category=Baseline2026.06 | 15.5 | |
| BaselineBackbone Model=Qwen3 8B, Defense Category=Baseline2026.06 | 14.8 | |
| CoSecBackbone Model=Qwen3 14B, Defense Category=Training-free2026.06 | 14.1 | |
| SPARKBackbone Model=Llama3 8B, Defense Category=SPARK+2026.06 | 12 | |
| CoSecBackbone Model=Gemma3 4B, Defense Category=Training-free2026.06 | 12 | |
| RESCUEBackbone Model=Llama3 8B, Defense Category=Training-free2026.06 | 11.3 | |
| SafeCoderBackbone Model=Qwen3 8B, Defense Category=Fine-tuning / Adapter2026.06 | 11.3 | |
| CoSecBackbone Model=Llama3 8B, Defense Category=Training-free2026.06 | 7 | |
| SafeCoderBackbone Model=Llama3 8B, Defense Category=Fine-tuning / Adapter2026.06 | 7 | |
| BaselineBackbone Model=Llama3 8B, Defense Category=Baseline2026.06 | 4.9 | |
| BaselineBackbone Model=CodeLlama 7B, Defense Category=Baseline2026.06 | 2.1 | |
| CoSecBackbone Model=CodeLlama 7B, Defense Category=Training-free2026.06 | 0.7 |