# Vulnerability Reproduction on CVE-based Vulnerability Dataset

Source: [Vulnerability Reproduction on CVE-based Vulnerability Dataset](<https://www.sota2.com/research/sota/vulnerability-reproduction-on-cve-based-vulnerability-dataset>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-07T09:51:16.797Z

Evaluation of the model's capability to reproduce vulnerabilities documented in the CVE-based Vulnerability Dataset, measured by success rate (Rs) and time-to-reproduce metrics (μTTE, Rtte).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Vulnerability Reproduction |
| Dataset (including any stated split) | CVE-based Vulnerability Dataset |
| Metric | Success Rate (Rs) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 29 of 29 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Success Rate (Rs)](<https://www.sota2.com/research/sota/vulnerability-reproduction-on-cve-based-vulnerability-dataset.md?metric=Success%20Rate%20(Rs)>): Higher is better; unit: PERCENT.

- [Mean Time To Reproduce (s)](<https://www.sota2.com/research/sota/vulnerability-reproduction-on-cve-based-vulnerability-dataset.md?metric=Mean%20Time%20To%20Reproduce%20(s)>): Lower is better; unit: TIME.

- [Relative Time To Reproduce (Rtte)](<https://www.sota2.com/research/sota/vulnerability-reproduction-on-cve-based-vulnerability-dataset.md?metric=Relative%20Time%20To%20Reproduce%20(Rtte)>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Success Rate (Rs) | Result date | Report paper |
| --- | --- | --- | --- |
| AFLGo-CT | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| AFLGo-VT | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| AFLGo-M | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| SelectFuzz-CT | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| SelectFuzz-VT | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| AFL++ | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| LiveFuzz | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| AFLGo-CT | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| LiveFuzz | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| LiveFuzz | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| SelectFuzz-VT | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| LiveFuzz | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| AFLGo-VT | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| LiveFuzz | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| AFL++ | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| LiveFuzz | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| AFLGo-VT | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| LiveFuzz | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| SelectFuzz-VT | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| LiveFuzz | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| AFL++ | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| LiveFuzz | 10 | Not recorded | 69d48fd67d0172140ec7465e |
| WindRanger | 8 | Not recorded | 69d48fd67d0172140ec7465e |
| AFLGo-CT | 6 | Not recorded | 69d48fd67d0172140ec7465e |
| AFLGo-VT | 6 | Not recorded | 69d48fd67d0172140ec7465e |
| LiveFuzz | 3 | Not recorded | 69d48fd67d0172140ec7465e |
| LiveFuzz | 2 | Not recorded | 69d48fd67d0172140ec7465e |
| LiveFuzz | 1 | Not recorded | 69d48fd67d0172140ec7465e |
| WindRanger | 0 | Not recorded | 69d48fd67d0172140ec7465e |

### AFLGo-CT

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c66.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2020-36130","Case No.":"1"}. This record does not assert independent reproduction.

### AFLGo-VT

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c67.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2020-36130","Case No.":"1"}. This record does not assert independent reproduction.

### AFLGo-M

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c68.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2020-36130","Case No.":"1"}. This record does not assert independent reproduction.

### SelectFuzz-CT

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c69.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2020-36130","Case No.":"1"}. This record does not assert independent reproduction.

### SelectFuzz-VT

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c6a.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2020-36130","Case No.":"1"}. This record does not assert independent reproduction.

### AFL++

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c6b.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2020-36130","Case No.":"1"}. This record does not assert independent reproduction.

### LiveFuzz

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c6c.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2020-36130","Case No.":"1"}. This record does not assert independent reproduction.

### AFLGo-CT

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c6d.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2023-2908","Case No.":"3"}. This record does not assert independent reproduction.

### LiveFuzz

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c6f.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2023-2908","Case No.":"3"}. This record does not assert independent reproduction.

### LiveFuzz

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c72.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2023-2908","Case No.":"4"}. This record does not assert independent reproduction.

### SelectFuzz-VT

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c74.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2021-3537","Case No.":"12"}. This record does not assert independent reproduction.

### LiveFuzz

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c75.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2021-3537","Case No.":"12"}. This record does not assert independent reproduction.

### AFLGo-VT

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c76.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2021-3517","Case No.":"12"}. This record does not assert independent reproduction.

### LiveFuzz

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c77.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2021-3517","Case No.":"12"}. This record does not assert independent reproduction.

### AFL++

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c78.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2021-3518","Case No.":"13"}. This record does not assert independent reproduction.

### LiveFuzz

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c79.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2021-3518","Case No.":"13"}. This record does not assert independent reproduction.

### AFLGo-VT

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c7b.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2021-37616","Case No.":"16"}. This record does not assert independent reproduction.

### LiveFuzz

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c7c.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2021-37616","Case No.":"16"}. This record does not assert independent reproduction.

### SelectFuzz-VT

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c7d.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2021-29457","Case No.":"17"}. This record does not assert independent reproduction.

### LiveFuzz

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c7e.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2021-29457","Case No.":"17"}. This record does not assert independent reproduction.

### AFL++

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c7f.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2021-3478","Case No.":"21"}. This record does not assert independent reproduction.

### LiveFuzz

Success Rate (Rs): 10. Result ID: 69d4d39247f34ce924bd0c80.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2021-3478","Case No.":"21"}. This record does not assert independent reproduction.

### WindRanger

Success Rate (Rs): 8. Result ID: 69d4d39247f34ce924bd0c6e.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2023-2908","Case No.":"3"}. This record does not assert independent reproduction.

### AFLGo-CT

Success Rate (Rs): 6. Result ID: 69d4d39247f34ce924bd0c70.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2023-2908","Case No.":"4"}. This record does not assert independent reproduction.

### AFLGo-VT

Success Rate (Rs): 6. Result ID: 69d4d39247f34ce924bd0c73.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2021-3537","Case No.":"12"}. This record does not assert independent reproduction.

### LiveFuzz

Success Rate (Rs): 3. Result ID: 69d4d39247f34ce924bd0c81.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2021-23215","Case No.":"22"}. This record does not assert independent reproduction.

### LiveFuzz

Success Rate (Rs): 2. Result ID: 69d4d39247f34ce924bd0c7a.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2020-24977","Case No.":"14"}. This record does not assert independent reproduction.

### LiveFuzz

Success Rate (Rs): 1. Result ID: 69d4d39247f34ce924bd0c82.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2020-11760","Case No.":"22"}. This record does not assert independent reproduction.

### WindRanger

Success Rate (Rs): 0. Result ID: 69d4d39247f34ce924bd0c71.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fd67d0172140ec7465e.md>)

Recorded evaluation configuration: {"CVE No.":"2023-2908","Case No.":"4"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
