List your company
ResearchFormerly WizWand

Secure Code Generation on Python (test)

94.4Safe Code RateSPARK + LoRA
12.34433.64754.9576.253Jun 15, 2026
Updated 4mo ago

Evaluation results

MethodLinks
SPARK + LoRABackbone Model=CodeLlama 7B, Defense Category=SPARK+2026.0694.4
LoRABackbone Model=CodeLlama 7B, Defense Category=Fine-tuning / Adapter2026.0692.2
SPARK + LoRABackbone Model=Gemma3 12B, Defense Category=SPARK+2026.0688
SPARK + LoRABackbone Model=Qwen3 14B, Defense Category=SPARK+2026.0686.6
LoRABackbone Model=Llama3 8B, Defense Category=Fine-tuning / Adapter2026.0684.5
SPARK + LoRABackbone Model=Llama3 8B, Defense Category=SPARK+2026.0683.8
SPARK + SVENBackbone Model=Llama3 8B, Defense Category=SPARK+2026.0682.4
SPARK + SVENBackbone Model=Qwen3 8B, Defense Category=SPARK+2026.0681.7
SPARK + LoRABackbone Model=Gemma3 4B, Defense Category=SPARK+2026.0681
LoRABackbone Model=Qwen3 14B, Defense Category=Fine-tuning / Adapter2026.0680.3
SPARK + SVENBackbone Model=Gemma3 12B, Defense Category=SPARK+2026.0679.6
SVENBackbone Model=Gemma3 4B, Defense Category=Fine-tuning / Adapter2026.0678.9
SPARK + SVENBackbone Model=Qwen3 14B, Defense Category=SPARK+2026.0677.5
SPARKBackbone Model=Gemma3 12B, Defense Category=SPARK+2026.0677.5
SVENBackbone Model=Gemma3 12B, Defense Category=Fine-tuning / Adapter2026.0676.8
LoRABackbone Model=Gemma3 4B, Defense Category=Fine-tuning / Adapter2026.0676.1
SPARK + LoRABackbone Model=Qwen3 8B, Defense Category=SPARK+2026.0674.5
GoodVibeBackbone Model=Llama3 8B, Defense Category=Fine-tuning / Adapter2026.0673.9
SVENBackbone Model=Qwen3 14B, Defense Category=Fine-tuning / Adapter2026.0672.5
CodeGuarderBackbone Model=Qwen3 14B, Defense Category=Training-free2026.0669.7
CodeGuarderBackbone Model=Gemma3 12B, Defense Category=Training-free2026.0668.3
SVENBackbone Model=Llama3 8B, Defense Category=Fine-tuning / Adapter2026.0666.9
LoRABackbone Model=Qwen3 8B, Defense Category=Fine-tuning / Adapter2026.0662
LoRABackbone Model=Gemma3 12B, Defense Category=Fine-tuning / Adapter2026.0661.4
GoodVibeBackbone Model=Qwen3 14B, Defense Category=Fine-tuning / Adapter2026.0660.6
SPARKBackbone Model=Qwen3 14B, Defense Category=SPARK+2026.0659.1
SPARKBackbone Model=Llama3 8B, Defense Category=SPARK+2026.0658.5
GoodVibeBackbone Model=Gemma3 4B, Defense Category=Fine-tuning / Adapter2026.0658.5
CodeGuarderBackbone Model=Llama3 8B, Defense Category=Training-free2026.0657.8
SafeCoderBackbone Model=CodeLlama 7B, Defense Category=Fine-tuning / Adapter2026.0657
RESCUEBackbone Model=Gemma3 12B, Defense Category=Training-free2026.0652.8
SPARKBackbone Model=Qwen3 8B, Defense Category=SPARK+2026.0652.1
GoodVibeBackbone Model=Gemma3 12B, Defense Category=Fine-tuning / Adapter2026.0652.1
CodeGuarderBackbone Model=CodeLlama 7B, Defense Category=Training-free2026.0651.4
SPARKBackbone Model=CodeLlama 7B, Defense Category=SPARK+2026.0650.7
SPARK + SVENBackbone Model=Gemma3 4B, Defense Category=SPARK+2026.0647.9
SafeCoderBackbone Model=Gemma3 12B, Defense Category=Fine-tuning / Adapter2026.0647.9
SafeCoderBackbone Model=Gemma3 4B, Defense Category=Fine-tuning / Adapter2026.0646.8
GoodVibeBackbone Model=CodeLlama 7B, Defense Category=Fine-tuning / Adapter2026.0646.5
GoodVibeBackbone Model=Qwen3 8B, Defense Category=Fine-tuning / Adapter2026.0646.5
RESCUEBackbone Model=Llama3 8B, Defense Category=Training-free2026.0645.8
RESCUEBackbone Model=Gemma3 4B, Defense Category=Training-free2026.0645.8
RESCUEBackbone Model=CodeLlama 7B, Defense Category=Training-free2026.0644.4
SPARKBackbone Model=Gemma3 4B, Defense Category=SPARK+2026.0644.4
SVENBackbone Model=CodeLlama 7B, Defense Category=Fine-tuning / Adapter2026.0643
SVENBackbone Model=Qwen3 8B, Defense Category=Fine-tuning / Adapter2026.0643
RESCUEBackbone Model=Qwen3 8B, Defense Category=Training-free2026.0642.2
SPARK + SVENBackbone Model=CodeLlama 7B, Defense Category=SPARK+2026.0641.5
CodeGuarderBackbone Model=Gemma3 4B, Defense Category=Training-free2026.0639.4
SafeCoderBackbone Model=Qwen3 8B, Defense Category=Fine-tuning / Adapter2026.0638
CodeGuarderBackbone Model=Qwen3 8B, Defense Category=Training-free2026.0637.3
RESCUEBackbone Model=Qwen3 14B, Defense Category=Training-free2026.0637.3
SafeCoderBackbone Model=Qwen3 14B, Defense Category=Fine-tuning / Adapter2026.0636.6
CoSecBackbone Model=Llama3 8B, Defense Category=Training-free2026.0634.5
BaselineBackbone Model=Llama3 8B, Defense Category=Baseline2026.0632.4
SafeCoderBackbone Model=Llama3 8B, Defense Category=Fine-tuning / Adapter2026.0632.4
CoSecBackbone Model=CodeLlama 7B, Defense Category=Training-free2026.0628.9
BaselineBackbone Model=Qwen3 8B, Defense Category=Baseline2026.0628.2
CoSecBackbone Model=Qwen3 8B, Defense Category=Training-free2026.0628.2
BaselineBackbone Model=Qwen3 14B, Defense Category=Baseline2026.0623.9
CoSecBackbone Model=Qwen3 14B, Defense Category=Training-free2026.0621.1
BaselineBackbone Model=Gemma3 4B, Defense Category=Baseline2026.0620.4
CoSecBackbone Model=Gemma3 4B, Defense Category=Training-free2026.0620.4
BaselineBackbone Model=CodeLlama 7B, Defense Category=Baseline2026.0617.6
BaselineBackbone Model=Gemma3 12B, Defense Category=Baseline2026.0617.6
CoSecBackbone Model=Gemma3 12B, Defense Category=Training-free2026.0615.5