Vulnerability Detection on Vulnerability Detection synthetic dataset 1.0 (test)
12.78F1 ScoreMulti-turn C-ing Clearly
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Multi-turn C-ing ClearlyBackbone=Llama-3.1-8B-Instruct, Token Budget=1B tokens2025.12 | 12.78 | 13.39 | 12.23 | |
| C-ing ClearlyBackbone=Llama-3.1-8B-Instruct, Token Budget=1B tokens2025.12 | 9.89 | 11.52 | 8.66 | |
| No C-ingBackbone=Llama-3.1-8B-Instruct, Token Budget=1B tokens2025.12 | 4.9 | 11.76 | 3.09 | |
| Llama-3.1-8B-InstructBackbone=Llama-3.1-8B-Instruct, Mode=Zero-shot / Base Model2025.12 | 3.08 | 1.78 | 11.46 |