List your company
ResearchFormerly WizWand

Vulnerability Detection on Reveal (test)

48.3PrecisionDISCO (MLM+CLR++NT-MLM)
3.590415.197726.80538.4123Oct 8, 2021Mar 29, 2022Sep 17, 2022Mar 9, 2023Aug 28, 2023Feb 16, 2024Aug 7, 2024
Updated 8mo ago

Evaluation results

MethodLinks
DISCO (MLM+CLR++NT-MLM)pre-training_objective=MLM + CLR + NT-MLM, negatives=hard negative samples2021.1048.344.646.4
GraphCodeBERTtype=pre-trained encoder-only2021.1047.943.945.8
DISCO (MLM)pre-training_objective=MLM only2021.1045.53136.9
CodeBERTtype=pre-trained encoder-only2021.1044.645.845.2
RoBERTatype=pre-trained encoder-only2021.1044.53941.6
Transformerlayers=12, initialization=from scratch2021.1041.645.343.4
DISCO (MLM+CLR±)pre-training_objective=MLM + CLR, input=source code sequence only2021.1039.450.544.2
DISCO (MLM+CLR+)pre-training_objective=MLM + CLR with hard negatives2021.1038.647.742.6
Devignarchitecture=GNN2021.1034.626.729.9
REVEALarchitecture=GNN + SMOTE + triplet loss2021.1030.860.941.3
SySeVRtype=DL-based VD tool2021.1024.540.130.3
ExtensionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Linevul2024.0820.6512.6215.67
ExtensionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Linevul2024.0818.0112.8114.97
VulDeePeckertype=DL-based VD tool2021.1017.713.915.7
InjectionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Reveal2024.0815.4361.4624.66
ExtensionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Devign2024.0815.238.1821.75
MutationAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Reveal2024.0815.0157.9623.85
ExtensionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Devign2024.0814.9737.2121.35
ExtensionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Reveal2024.0814.8252.7123.13
ExtensionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Reveal2024.0814.765022.8
ROSDLVD Model=Reveal2024.0814.3554.5222.72
InjectionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Reveal2024.0814.2364.4823.32
InjectionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Devign2024.0813.6754.2821.83
InjectionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Devign2024.0813.4453.2621.46
ROSDLVD Model=Devign2024.0813.2839.9319.93
NoAugDLVD Model=Reveal2024.0812.965.1421.54
VulGenDLVD Model=Reveal2024.0812.4664.620.9
MutationAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Reveal2024.0812.2368.4620.75
VGXDLVD Model=Reveal2024.0811.6965.6219.84
InjectionAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Linevul2024.0811.5726.4316.1
VGXDLVD Model=Devign2024.0811.0259.3518.58
MutationAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Devign2024.0810.9853.4418.22
MutationAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Devign2024.0810.9661.6418.6
NoAugDLVD Model=Devign2024.0810.5947.2317.3
VulGenDLVD Model=Devign2024.0810.4557.917.7
InjectionAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Linevul2024.089.9925.7914.4
ROSDLVD Model=Linevul2024.089.8822.7113.77
VGXDLVD Model=Linevul2024.089.5187.2411.47
MutationAugmentation LLM=CodeQwen 1.5-7B-Chat, DLVD Model=Linevul2024.089.4830.4314.45
MutationAugmentation LLM=ChatGPT 3.5 Turbo, DLVD Model=Linevul2024.087.822.6211.6
NoAugDLVD Model=Linevul2024.085.5716.988.39
VulGenDLVD Model=Linevul2024.085.3198.0910.08