Vulnerability Detection on Bigvul (test)
19.03PrecisionExtension
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ExtensionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Linevul2024.08 | 19.03 | 11.96 | 14.68 | |
| ExtensionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Linevul2024.08 | 15.74 | 11.86 | 13.53 | |
| InjectionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Reveal2024.08 | 11.64 | 38 | 17.82 | |
| InjectionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Linevul2024.08 | 11.43 | 18.81 | 14.22 | |
| ExtensionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Reveal2024.08 | 11.13 | 34.02 | 16.77 | |
| ROSDLVD Model=Linevul2024.08 | 10.91 | 13.16 | 11.93 | |
| ExtensionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Devign2024.08 | 10.6 | 17.33 | 13.16 | |
| InjectionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Devign2024.08 | 10.33 | 31.8 | 15.59 | |
| ExtensionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Reveal2024.08 | 10.22 | 33.86 | 15.7 | |
| InjectionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Reveal2024.08 | 9.91 | 38.16 | 15.74 | |
| ExtensionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Devign2024.08 | 9.89 | 31.48 | 15.05 | |
| MutationAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Reveal2024.08 | 9.37 | 53.26 | 15.94 | |
| InjectionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Devign2024.08 | 8.79 | 29.41 | 13.53 | |
| VulGenDLVD Model=Linevul2024.08 | 8.51 | 22.15 | 12.29 | |
| ROSDLVD Model=Reveal2024.08 | 7.96 | 33.39 | 12.86 | |
| NoAugDLVD Model=Linevul2024.08 | 7.9 | 29.19 | 12.43 | |
| InjectionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Linevul2024.08 | 7.85 | 30.49 | 12.49 | |
| MutationAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Devign2024.08 | 7.8 | 63.91 | 13.9 | |
| MutationAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Reveal2024.08 | 7.63 | 67.73 | 13.72 | |
| MutationAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Devign2024.08 | 7.56 | 57.23 | 13.36 | |
| ROSDLVD Model=Devign2024.08 | 7.54 | 25.6 | 11.65 | |
| NoAugDLVD Model=Reveal2024.08 | 7.28 | 77.27 | 13.31 | |
| VGXDLVD Model=Reveal2024.08 | 6.89 | 73.29 | 12.6 | |
| MutationAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Linevul2024.08 | 6.78 | 74.14 | 12.42 | |
| MutationAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Linevul2024.08 | 6.65 | 78.31 | 12.25 | |
| VulGenDLVD Model=Devign2024.08 | 6.49 | 62.32 | 11.75 | |
| VulGenDLVD Model=Reveal2024.08 | 6.36 | 70.59 | 11.66 | |
| NoAugDLVD Model=Devign2024.08 | 6.27 | 43.24 | 10.95 | |
| VGXDLVD Model=Devign2024.08 | 6.06 | 59.3 | 10.99 | |
| VGXDLVD Model=Linevul2024.08 | 5.35 | 98.82 | 10.15 |