Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Vulnerability Detection research benchmarks – Page 6 · SOTA2 Research

Vulnerability Detection

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

1Unique Vulnerabilities

2

Mar 9, 2026

93.5Accuracy

2

Feb 26, 2026

90.62Accuracy

2

Feb 26, 2026

Java P3 X1 (test)

86ROC AUC

2

Feb 26, 2026

X1 without P3 (test)

0.69ROC AUC

2

Feb 26, 2026

66Accuracy

1

May 14, 2026

JAVA CWE Detection

86F1 Score

1

May 14, 2026

C/C++ Vulnerability Detection

Steenhoek et al.

54.5Balanced Accuracy

1

May 14, 2026

99Accuracy

1

May 14, 2026

93.54Accuracy

1

Apr 2, 2026

VulD-Transformer

87.5Accuracy

1

Apr 2, 2026

Projects P1-P8 (test)

17True Positives (TP)

1

Apr 2, 2026

500 randomly sampled upgradable smart contracts (manual verification)

92.26Precision

1

Feb 26, 2026

27.38Precision

1

Feb 26, 2026

Real-world Go bugs dataset goprotobuf 2013

—

—Primary metric

0

May 6, 2026

Real-world Go bugs dataset coredns 2025

—

—Primary metric

0

May 6, 2026

Real-world Go bugs dataset kube-sm 2025

—

—Primary metric

0

May 6, 2026

Real-world Go bugs evm-gascost 2017

—

—Primary metric

0

May 6, 2026

Real-world Go bugs geth-tracers 2024

—

—Primary metric

0

May 6, 2026

Real-world Go bugs dataset geth-graphql 2025

—

—Primary metric

0

May 6, 2026

Real-world Go bugs dataset kubelet 2025

—

—Primary metric

0

May 6, 2026

Real-world Go bugs dataset kubectl 2025

—

—Primary metric

0

May 6, 2026

12 Solana Smart Contracts April to November 2022 (Evaluation)

—

—Primary metric

0

Mar 18, 2026

Page 6 of 6

Popular datasets

PrimeVul SkillVetBench Real-world Go bugs dataset Bigvul SARD

Follow for updates

Join SOTA2 Contact