# Vulnerability Detection on Dataset (test) Source: [Vulnerability Detection on Dataset (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:07:43.237Z Evaluation of vulnerability detection performance using the test split of the Dataset dataset, measured by True Positives (TP), False Negatives (FN), Total samples, and Recall. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Vulnerability Detection | | Dataset (including any stated split) | Dataset (test) | | Metric | True Positives | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [True Positives](): Higher is better; unit: SCALAR. - [False Negatives](): Lower is better; unit: SCALAR. - [Total Samples](): Higher is better; unit: SCALAR. - [Recall](): Higher is better; unit: PERCENT. ## Recorded results | Method | True Positives | Result date | Report paper | | --- | --- | --- | --- | | SemTaint | 106 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 26 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 23 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 17 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 11 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 7 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 6 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 4 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 4 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 2 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 2 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 1 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 1 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 1 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 1 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 0 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 0 | Not recorded | 696dba85e25ad2fa9d1eccf4 | | SemTaint | 0 | Not recorded | 696dba85e25ad2fa9d1eccf4 | ### SemTaint True Positives: 106. Result ID: 6996edca5698665ec43a54b5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"Total"}. This record does not assert independent reproduction. ### SemTaint True Positives: 26. Result ID: 6996edca5698665ec43a54a4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-400"}. This record does not assert independent reproduction. ### SemTaint True Positives: 23. Result ID: 6996edca5698665ec43a54a5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-22"}. This record does not assert independent reproduction. ### SemTaint True Positives: 17. Result ID: 6996edca5698665ec43a54a6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-79"}. This record does not assert independent reproduction. ### SemTaint True Positives: 11. Result ID: 6996edca5698665ec43a54a7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-78"}. This record does not assert independent reproduction. ### SemTaint True Positives: 7. Result ID: 6996edca5698665ec43a54a8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-94"}. This record does not assert independent reproduction. ### SemTaint True Positives: 6. Result ID: 6996edca5698665ec43a54aa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-915"}. This record does not assert independent reproduction. ### SemTaint True Positives: 4. Result ID: 6996edca5698665ec43a54a9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-89"}. This record does not assert independent reproduction. ### SemTaint True Positives: 4. Result ID: 6996edca5698665ec43a54ab. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-730"}. This record does not assert independent reproduction. ### SemTaint True Positives: 2. Result ID: 6996edca5698665ec43a54ac. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-502"}. This record does not assert independent reproduction. ### SemTaint True Positives: 2. Result ID: 6996edca5698665ec43a54ae. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-201"}. This record does not assert independent reproduction. ### SemTaint True Positives: 1. Result ID: 6996edca5698665ec43a54ad. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-200"}. This record does not assert independent reproduction. ### SemTaint True Positives: 1. Result ID: 6996edca5698665ec43a54af. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-346"}. This record does not assert independent reproduction. ### SemTaint True Positives: 1. Result ID: 6996edca5698665ec43a54b0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-601"}. This record does not assert independent reproduction. ### SemTaint True Positives: 1. Result ID: 6996edca5698665ec43a54b1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-74"}. This record does not assert independent reproduction. ### SemTaint True Positives: 0. Result ID: 6996edca5698665ec43a54b2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-829"}. This record does not assert independent reproduction. ### SemTaint True Positives: 0. Result ID: 6996edca5698665ec43a54b3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-918"}. This record does not assert independent reproduction. ### SemTaint True Positives: 0. Result ID: 6996edca5698665ec43a54b4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CWE":"CWE-327"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.