List your company

Vulnerability Generation on Vulnerability Generation Prompt Dataset (test)

68.7VGRGPT-3.5-Turbo
-2.74815.80134.3552.899Jun 9, 2026

Evaluation results

MethodLinks
GPT-3.5-Turbon (Sample Size)=500, Prompt Condition=Adversarial2026.0668.7
GPT-3.5-Turbon (Sample Size)=500, Prompt Condition=Mean2026.0652
GPT-4n (Sample Size)=300, Prompt Condition=Adversarial2026.0640
Mean (All Models)n (Sample Size)=2,800, Prompt Condition=Adversarial2026.0637.4
GPT-4n (Sample Size)=300, Prompt Condition=Mean2026.0630
Mean (All Models)n (Sample Size)=2,800, Prompt Condition=Mean2026.0627.5
CodeT5+n (Sample Size)=1,000, Prompt Condition=Adversarial2026.0622.7
CodeLlaman (Sample Size)=1,000, Prompt Condition=Adversarial2026.0618.3
CodeT5+n (Sample Size)=1,000, Prompt Condition=Mean2026.0615
CodeLlaman (Sample Size)=1,000, Prompt Condition=Mean2026.0613.1
CodeLlaman (Sample Size)=1,000, Prompt Condition=Baseline2026.0612
Mean (All Models)n (Sample Size)=2,800, Prompt Condition=Baseline2026.063.5
CodeT5+n (Sample Size)=1,000, Prompt Condition=Baseline2026.062
GPT-3.5-Turbon (Sample Size)=500, Prompt Condition=Baseline2026.060
GPT-4n (Sample Size)=300, Prompt Condition=Baseline2026.060