# Vulnerability Detection on All Lang. 343 vulnerabilities (test)

Source: [Vulnerability Detection on All Lang. 343 vulnerabilities (test)](<https://www.sota2.com/research/sota/vulnerability-detection-on-all-lang-343-vulnerabilities-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-14T08:10:48.428Z

Evaluation of vulnerability detection performance using the test split of the All Lang. 343 vulnerabilities dataset, measured by True Positives (TP), False Negatives (FN), False Positives (FP), True Positive Rate (TPR), and False Discovery Rate (FDR).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Vulnerability Detection |
| Dataset (including any stated split) | All Lang. 343 vulnerabilities (test) |
| Metric | True Positives (TP) |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 2 of 2 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [True Positives (TP)](<https://www.sota2.com/research/sota/vulnerability-detection-on-all-lang-343-vulnerabilities-test.md?metric=True%20Positives%20(TP)>): Higher is better; unit: SCALAR.

- [False Negatives (FN)](<https://www.sota2.com/research/sota/vulnerability-detection-on-all-lang-343-vulnerabilities-test.md?metric=False%20Negatives%20(FN)>): Lower is better; unit: SCALAR.

- [False Positives (FP)](<https://www.sota2.com/research/sota/vulnerability-detection-on-all-lang-343-vulnerabilities-test.md?metric=False%20Positives%20(FP)>): Lower is better; unit: SCALAR.

- [True Positive Rate (TPR)](<https://www.sota2.com/research/sota/vulnerability-detection-on-all-lang-343-vulnerabilities-test.md?metric=True%20Positive%20Rate%20(TPR)>): Higher is better; unit: PERCENT.

- [False Discovery Rate (FDR)](<https://www.sota2.com/research/sota/vulnerability-detection-on-all-lang-343-vulnerabilities-test.md?metric=False%20Discovery%20Rate%20(FDR)>): Lower is better; unit: PERCENT.

## Recorded results

| Method | True Positives (TP) | Result date | Report paper |
| --- | --- | --- | --- |
| MoCQ | 269 | Not recorded | 68fa7a311e209131cea81a9f |
| Pure LLM | 185 | Not recorded | 68fa7a311e209131cea81a9f |

### MoCQ

True Positives (TP): 269. Result ID: 69ddf5b247f34ce924c53ff6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a311e209131cea81a9f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a311e209131cea81a9f.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Pure LLM

True Positives (TP): 185. Result ID: 69ddf5b247f34ce924c53ff5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a311e209131cea81a9f.md>)

Recorded evaluation configuration: {"LLM Model":"Claude 3.7 Sonnet"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
