List your company
ResearchFormerly WizWand

Vulnerability Detection on Bigvul (test)

19.03PrecisionExtension
4.80288.496412.1915.8836Aug 7, 2024
Updated 8mo ago

Evaluation results

MethodLinks
ExtensionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Linevul2024.0819.0311.9614.68
ExtensionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Linevul2024.0815.7411.8613.53
InjectionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Reveal2024.0811.643817.82
InjectionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Linevul2024.0811.4318.8114.22
ExtensionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Reveal2024.0811.1334.0216.77
ROSDLVD Model=Linevul2024.0810.9113.1611.93
ExtensionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Devign2024.0810.617.3313.16
InjectionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Devign2024.0810.3331.815.59
ExtensionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Reveal2024.0810.2233.8615.7
InjectionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Reveal2024.089.9138.1615.74
ExtensionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Devign2024.089.8931.4815.05
MutationAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Reveal2024.089.3753.2615.94
InjectionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Devign2024.088.7929.4113.53
VulGenDLVD Model=Linevul2024.088.5122.1512.29
ROSDLVD Model=Reveal2024.087.9633.3912.86
NoAugDLVD Model=Linevul2024.087.929.1912.43
InjectionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Linevul2024.087.8530.4912.49
MutationAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Devign2024.087.863.9113.9
MutationAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Reveal2024.087.6367.7313.72
MutationAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Devign2024.087.5657.2313.36
ROSDLVD Model=Devign2024.087.5425.611.65
NoAugDLVD Model=Reveal2024.087.2877.2713.31
VGXDLVD Model=Reveal2024.086.8973.2912.6
MutationAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Linevul2024.086.7874.1412.42
MutationAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Linevul2024.086.6578.3112.25
VulGenDLVD Model=Devign2024.086.4962.3211.75
VulGenDLVD Model=Reveal2024.086.3670.5911.66
NoAugDLVD Model=Devign2024.086.2743.2410.95
VGXDLVD Model=Devign2024.086.0659.310.99
VGXDLVD Model=Linevul2024.085.3598.8210.15