List your company
ResearchFormerly WizWand

Secure Code Generation on Java (evaluation)

98.6Safe Code RateLoRA
6.35230.30154.2578.199Jun 15, 2026
Updated 4mo ago

Evaluation results

MethodLinks
LoRABackbone Model=CodeLlama 7B, Defense Category=Fine-tuning / Adapter2026.0698.6
SPARK + LoRABackbone Model=CodeLlama 7B, Defense Category=SPARK+2026.0698.6
SPARKBackbone Model=CodeLlama 7B, Defense Category=SPARK+2026.0697.9
SPARK + SVENBackbone Model=CodeLlama 7B, Defense Category=SPARK+2026.0695.1
GoodVibeBackbone Model=Llama3 8B, Defense Category=Fine-tuning / Adapter2026.0693.7
SVENBackbone Model=Gemma3 12B, Defense Category=Fine-tuning / Adapter2026.0691.5
SPARK + LoRABackbone Model=Llama3 8B, Defense Category=SPARK+2026.0685.2
SPARKBackbone Model=Qwen3 14B, Defense Category=SPARK+2026.0683.8
SPARKBackbone Model=Qwen3 8B, Defense Category=SPARK+2026.0682.4
SPARK + LoRABackbone Model=Gemma3 4B, Defense Category=SPARK+2026.0679.6
SVENBackbone Model=Gemma3 4B, Defense Category=Fine-tuning / Adapter2026.0677.5
SPARK + SVENBackbone Model=Gemma3 4B, Defense Category=SPARK+2026.0676.8
SPARK + SVENBackbone Model=Qwen3 14B, Defense Category=SPARK+2026.0676.1
SPARK + LoRABackbone Model=Gemma3 12B, Defense Category=SPARK+2026.0674.7
SPARK + SVENBackbone Model=Qwen3 8B, Defense Category=SPARK+2026.0673.2
CodeGuarderBackbone Model=Qwen3 14B, Defense Category=Training-free2026.0673.2
SPARK + LoRABackbone Model=Qwen3 8B, Defense Category=SPARK+2026.0672.5
LoRABackbone Model=Llama3 8B, Defense Category=Fine-tuning / Adapter2026.0671.8
SPARKBackbone Model=Llama3 8B, Defense Category=SPARK+2026.0671.8
GoodVibeBackbone Model=CodeLlama 7B, Defense Category=Fine-tuning / Adapter2026.0670.4
SPARK + SVENBackbone Model=Llama3 8B, Defense Category=SPARK+2026.0667.6
SPARKBackbone Model=Gemma3 4B, Defense Category=SPARK+2026.0667.6
CodeGuarderBackbone Model=Gemma3 12B, Defense Category=Training-free2026.0666.9
SPARKBackbone Model=Gemma3 12B, Defense Category=SPARK+2026.0666.9
SPARK + LoRABackbone Model=Qwen3 14B, Defense Category=SPARK+2026.0665.5
SVENBackbone Model=Qwen3 14B, Defense Category=Fine-tuning / Adapter2026.0663.4
SPARK + SVENBackbone Model=Gemma3 12B, Defense Category=SPARK+2026.0663.4
CodeGuarderBackbone Model=Qwen3 8B, Defense Category=Training-free2026.0662
CodeGuarderBackbone Model=Gemma3 4B, Defense Category=Training-free2026.0660.6
CodeGuarderBackbone Model=Llama3 8B, Defense Category=Training-free2026.0657.8
RESCUEBackbone Model=Qwen3 8B, Defense Category=Training-free2026.0657
LoRABackbone Model=Qwen3 8B, Defense Category=Fine-tuning / Adapter2026.0654.2
CoSecBackbone Model=Qwen3 14B, Defense Category=Training-free2026.0654.2
CoSecBackbone Model=Qwen3 8B, Defense Category=Training-free2026.0653.5
SafeCoderBackbone Model=Qwen3 14B, Defense Category=Fine-tuning / Adapter2026.0652.8
SafeCoderBackbone Model=CodeLlama 7B, Defense Category=Fine-tuning / Adapter2026.0652.1
RESCUEBackbone Model=Qwen3 14B, Defense Category=Training-free2026.0652.1
BaselineBackbone Model=Qwen3 8B, Defense Category=Baseline2026.0651.4
BaselineBackbone Model=Qwen3 14B, Defense Category=Baseline2026.0651.4
RESCUEBackbone Model=Gemma3 4B, Defense Category=Training-free2026.0651.4
SafeCoderBackbone Model=Qwen3 8B, Defense Category=Fine-tuning / Adapter2026.0650.7
RESCUEBackbone Model=Gemma3 12B, Defense Category=Training-free2026.0650
GoodVibeBackbone Model=Qwen3 14B, Defense Category=Fine-tuning / Adapter2026.0648.6
SafeCoderBackbone Model=Gemma3 12B, Defense Category=Fine-tuning / Adapter2026.0648.6
LoRABackbone Model=Qwen3 14B, Defense Category=Fine-tuning / Adapter2026.0646.5
BaselineBackbone Model=Gemma3 4B, Defense Category=Baseline2026.0646.5
SafeCoderBackbone Model=Gemma3 4B, Defense Category=Fine-tuning / Adapter2026.0645.4
CodeGuarderBackbone Model=CodeLlama 7B, Defense Category=Training-free2026.0644.4
RESCUEBackbone Model=CodeLlama 7B, Defense Category=Training-free2026.0643.7
CoSecBackbone Model=Llama3 8B, Defense Category=Training-free2026.0643.7
LoRABackbone Model=Gemma3 4B, Defense Category=Fine-tuning / Adapter2026.0642.2
BaselineBackbone Model=Llama3 8B, Defense Category=Baseline2026.0641.5
BaselineBackbone Model=CodeLlama 7B, Defense Category=Baseline2026.0640.9
CoSecBackbone Model=CodeLlama 7B, Defense Category=Training-free2026.0640.9
CoSecBackbone Model=Gemma3 4B, Defense Category=Training-free2026.0640.9
RESCUEBackbone Model=Llama3 8B, Defense Category=Training-free2026.0640.1
BaselineBackbone Model=Gemma3 12B, Defense Category=Baseline2026.0640.1
CoSecBackbone Model=Gemma3 12B, Defense Category=Training-free2026.0638.7
GoodVibeBackbone Model=Gemma3 4B, Defense Category=Fine-tuning / Adapter2026.0635.9
SafeCoderBackbone Model=Llama3 8B, Defense Category=Fine-tuning / Adapter2026.0632.4
LoRABackbone Model=Gemma3 12B, Defense Category=Fine-tuning / Adapter2026.0631
GoodVibeBackbone Model=Gemma3 12B, Defense Category=Fine-tuning / Adapter2026.0631
SVENBackbone Model=Llama3 8B, Defense Category=Fine-tuning / Adapter2026.0630.3
GoodVibeBackbone Model=Qwen3 8B, Defense Category=Fine-tuning / Adapter2026.0625.5
SVENBackbone Model=Qwen3 8B, Defense Category=Fine-tuning / Adapter2026.0621.1
SVENBackbone Model=CodeLlama 7B, Defense Category=Fine-tuning / Adapter2026.069.9