Secure Code Generation on Python (test)
94.4Safe Code RateSPARK + LoRA
Evaluation Results
| Method | Links | |
|---|---|---|
| SPARK + LoRABackbone Model=CodeLlama 7B, Defense Category=SPARK+2026.06 | 94.4 | |
| LoRABackbone Model=CodeLlama 7B, Defense Category=Fine-tuning / Adapter2026.06 | 92.2 | |
| SPARK + LoRABackbone Model=Gemma3 12B, Defense Category=SPARK+2026.06 | 88 | |
| SPARK + LoRABackbone Model=Qwen3 14B, Defense Category=SPARK+2026.06 | 86.6 | |
| LoRABackbone Model=Llama3 8B, Defense Category=Fine-tuning / Adapter2026.06 | 84.5 | |
| SPARK + LoRABackbone Model=Llama3 8B, Defense Category=SPARK+2026.06 | 83.8 | |
| SPARK + SVENBackbone Model=Llama3 8B, Defense Category=SPARK+2026.06 | 82.4 | |
| SPARK + SVENBackbone Model=Qwen3 8B, Defense Category=SPARK+2026.06 | 81.7 | |
| SPARK + LoRABackbone Model=Gemma3 4B, Defense Category=SPARK+2026.06 | 81 | |
| LoRABackbone Model=Qwen3 14B, Defense Category=Fine-tuning / Adapter2026.06 | 80.3 | |
| SPARK + SVENBackbone Model=Gemma3 12B, Defense Category=SPARK+2026.06 | 79.6 | |
| SVENBackbone Model=Gemma3 4B, Defense Category=Fine-tuning / Adapter2026.06 | 78.9 | |
| SPARK + SVENBackbone Model=Qwen3 14B, Defense Category=SPARK+2026.06 | 77.5 | |
| SPARKBackbone Model=Gemma3 12B, Defense Category=SPARK+2026.06 | 77.5 | |
| SVENBackbone Model=Gemma3 12B, Defense Category=Fine-tuning / Adapter2026.06 | 76.8 | |
| LoRABackbone Model=Gemma3 4B, Defense Category=Fine-tuning / Adapter2026.06 | 76.1 | |
| SPARK + LoRABackbone Model=Qwen3 8B, Defense Category=SPARK+2026.06 | 74.5 | |
| GoodVibeBackbone Model=Llama3 8B, Defense Category=Fine-tuning / Adapter2026.06 | 73.9 | |
| SVENBackbone Model=Qwen3 14B, Defense Category=Fine-tuning / Adapter2026.06 | 72.5 | |
| CodeGuarderBackbone Model=Qwen3 14B, Defense Category=Training-free2026.06 | 69.7 | |
| CodeGuarderBackbone Model=Gemma3 12B, Defense Category=Training-free2026.06 | 68.3 | |
| SVENBackbone Model=Llama3 8B, Defense Category=Fine-tuning / Adapter2026.06 | 66.9 | |
| LoRABackbone Model=Qwen3 8B, Defense Category=Fine-tuning / Adapter2026.06 | 62 | |
| LoRABackbone Model=Gemma3 12B, Defense Category=Fine-tuning / Adapter2026.06 | 61.4 | |
| GoodVibeBackbone Model=Qwen3 14B, Defense Category=Fine-tuning / Adapter2026.06 | 60.6 | |
| SPARKBackbone Model=Qwen3 14B, Defense Category=SPARK+2026.06 | 59.1 | |
| SPARKBackbone Model=Llama3 8B, Defense Category=SPARK+2026.06 | 58.5 | |
| GoodVibeBackbone Model=Gemma3 4B, Defense Category=Fine-tuning / Adapter2026.06 | 58.5 | |
| CodeGuarderBackbone Model=Llama3 8B, Defense Category=Training-free2026.06 | 57.8 | |
| SafeCoderBackbone Model=CodeLlama 7B, Defense Category=Fine-tuning / Adapter2026.06 | 57 | |
| RESCUEBackbone Model=Gemma3 12B, Defense Category=Training-free2026.06 | 52.8 | |
| SPARKBackbone Model=Qwen3 8B, Defense Category=SPARK+2026.06 | 52.1 | |
| GoodVibeBackbone Model=Gemma3 12B, Defense Category=Fine-tuning / Adapter2026.06 | 52.1 | |
| CodeGuarderBackbone Model=CodeLlama 7B, Defense Category=Training-free2026.06 | 51.4 | |
| SPARKBackbone Model=CodeLlama 7B, Defense Category=SPARK+2026.06 | 50.7 | |
| SPARK + SVENBackbone Model=Gemma3 4B, Defense Category=SPARK+2026.06 | 47.9 | |
| SafeCoderBackbone Model=Gemma3 12B, Defense Category=Fine-tuning / Adapter2026.06 | 47.9 | |
| SafeCoderBackbone Model=Gemma3 4B, Defense Category=Fine-tuning / Adapter2026.06 | 46.8 | |
| GoodVibeBackbone Model=CodeLlama 7B, Defense Category=Fine-tuning / Adapter2026.06 | 46.5 | |
| GoodVibeBackbone Model=Qwen3 8B, Defense Category=Fine-tuning / Adapter2026.06 | 46.5 | |
| RESCUEBackbone Model=Llama3 8B, Defense Category=Training-free2026.06 | 45.8 | |
| RESCUEBackbone Model=Gemma3 4B, Defense Category=Training-free2026.06 | 45.8 | |
| RESCUEBackbone Model=CodeLlama 7B, Defense Category=Training-free2026.06 | 44.4 | |
| SPARKBackbone Model=Gemma3 4B, Defense Category=SPARK+2026.06 | 44.4 | |
| SVENBackbone Model=CodeLlama 7B, Defense Category=Fine-tuning / Adapter2026.06 | 43 | |
| SVENBackbone Model=Qwen3 8B, Defense Category=Fine-tuning / Adapter2026.06 | 43 | |
| RESCUEBackbone Model=Qwen3 8B, Defense Category=Training-free2026.06 | 42.2 | |
| SPARK + SVENBackbone Model=CodeLlama 7B, Defense Category=SPARK+2026.06 | 41.5 | |
| CodeGuarderBackbone Model=Gemma3 4B, Defense Category=Training-free2026.06 | 39.4 | |
| SafeCoderBackbone Model=Qwen3 8B, Defense Category=Fine-tuning / Adapter2026.06 | 38 | |
| CodeGuarderBackbone Model=Qwen3 8B, Defense Category=Training-free2026.06 | 37.3 | |
| RESCUEBackbone Model=Qwen3 14B, Defense Category=Training-free2026.06 | 37.3 | |
| SafeCoderBackbone Model=Qwen3 14B, Defense Category=Fine-tuning / Adapter2026.06 | 36.6 | |
| CoSecBackbone Model=Llama3 8B, Defense Category=Training-free2026.06 | 34.5 | |
| BaselineBackbone Model=Llama3 8B, Defense Category=Baseline2026.06 | 32.4 | |
| SafeCoderBackbone Model=Llama3 8B, Defense Category=Fine-tuning / Adapter2026.06 | 32.4 | |
| CoSecBackbone Model=CodeLlama 7B, Defense Category=Training-free2026.06 | 28.9 | |
| BaselineBackbone Model=Qwen3 8B, Defense Category=Baseline2026.06 | 28.2 | |
| CoSecBackbone Model=Qwen3 8B, Defense Category=Training-free2026.06 | 28.2 | |
| BaselineBackbone Model=Qwen3 14B, Defense Category=Baseline2026.06 | 23.9 | |
| CoSecBackbone Model=Qwen3 14B, Defense Category=Training-free2026.06 | 21.1 | |
| BaselineBackbone Model=Gemma3 4B, Defense Category=Baseline2026.06 | 20.4 | |
| CoSecBackbone Model=Gemma3 4B, Defense Category=Training-free2026.06 | 20.4 | |
| BaselineBackbone Model=CodeLlama 7B, Defense Category=Baseline2026.06 | 17.6 | |
| BaselineBackbone Model=Gemma3 12B, Defense Category=Baseline2026.06 | 17.6 | |
| CoSecBackbone Model=Gemma3 12B, Defense Category=Training-free2026.06 | 15.5 |