Code Security Vulnerability Repair on LiveCVEBench (LCB) (test)
41.27Success RateClaude Opus 4.5
Evaluation Results
| Method | Links | |
|---|---|---|
| Claude Opus 4.5Base Model=Claude Opus 4.52026.02 | 41.27 | |
| Qwen3-32B + CVE-Factory (4k)Fine-tuning Data Source=CVE-Factory, Training Data Scale (Trajectories)=4k, Base Model=Qwen3-32B2026.02 | 35.79 | |
| Claude Sonnet 4.5Base Model=Claude Sonnet 4.52026.02 | 34.39 | |
| Qwen3-32B + CVE-Factory (3k)Fine-tuning Data Source=CVE-Factory, Training Data Scale (Trajectories)=3k, Base Model=Qwen3-32B2026.02 | 31.05 | |
| MiniMax-M2Base Model=MiniMax-M22026.02 | 24.87 | |
| Qwen3-32B + SETAFine-tuning Data Source=SETA, Training Data Scale (Trajectories)=4k, Base Model=Qwen3-32B2026.02 | 21.69 | |
| Claude Sonnet 4Base Model=Claude Sonnet 42026.02 | 20.11 | |
| Qwen 3 Coder 480BBase Model=Qwen 3 Coder 480B2026.02 | 19.58 | |
| Qwen3-Coder-30BBase Model=Qwen3-Coder-30B2026.02 | 10.58 | |
| Qwen3-32BBase Model=Qwen3-32B2026.02 | 5.29 |