# ERC Compliance Validation on ground-truth dataset

Source: [ERC Compliance Validation on ground-truth dataset](<https://www.sota2.com/research/sota/erc-compliance-validation-on-ground-truth-dataset>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-04T10:42:55.946Z

Evaluation of ERC Compliance Validation performance on the ground-truth dataset, measured using True Positives, False Positives, and False Negatives.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | ERC Compliance Validation |
| Dataset (including any stated split) | ground-truth dataset |
| Metric | True Positives (TP) |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 28 of 28 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [True Positives (TP)](<https://www.sota2.com/research/sota/erc-compliance-validation-on-ground-truth-dataset.md?metric=True%20Positives%20(TP)>): Higher is better; unit: SCALAR.

- [False Positives (FP)](<https://www.sota2.com/research/sota/erc-compliance-validation-on-ground-truth-dataset.md?metric=False%20Positives%20(FP)>): Lower is better; unit: SCALAR.

- [False Negatives (FN)](<https://www.sota2.com/research/sota/erc-compliance-validation-on-ground-truth-dataset.md?metric=False%20Negatives%20(FN)>): Lower is better; unit: SCALAR.

## Recorded results

| Method | True Positives (TP) | Result date | Report paper |
| --- | --- | --- | --- |
| SymGPT | 157 | Not recorded | 68fa76f21e209131cea70273 |
| SymGPT | 76 | Not recorded | 68fa76f21e209131cea70273 |
| SymGPT | 53 | Not recorded | 68fa76f21e209131cea70273 |
| Slither | 39 | Not recorded | 68fa76f21e209131cea70273 |
| SymGPT | 28 | Not recorded | 68fa76f21e209131cea70273 |
| Slither | 26 | Not recorded | 68fa76f21e209131cea70273 |
| Slither | 13 | Not recorded | 68fa76f21e209131cea70273 |
| ERCx | 12 | Not recorded | 68fa76f21e209131cea70273 |
| ERCx | 12 | Not recorded | 68fa76f21e209131cea70273 |
| ZepScope | 2 | Not recorded | 68fa76f21e209131cea70273 |
| ZepScope | 2 | Not recorded | 68fa76f21e209131cea70273 |
| Slither | 0 | Not recorded | 68fa76f21e209131cea70273 |
| AChecker | 0 | Not recorded | 68fa76f21e209131cea70273 |
| AChecker | 0 | Not recorded | 68fa76f21e209131cea70273 |
| AChecker | 0 | Not recorded | 68fa76f21e209131cea70273 |
| AChecker | 0 | Not recorded | 68fa76f21e209131cea70273 |
| ZepScope | 0 | Not recorded | 68fa76f21e209131cea70273 |
| ZepScope | 0 | Not recorded | 68fa76f21e209131cea70273 |
| NFTGuard | 0 | Not recorded | 68fa76f21e209131cea70273 |
| NFTGuard | 0 | Not recorded | 68fa76f21e209131cea70273 |
| NFTGuard | 0 | Not recorded | 68fa76f21e209131cea70273 |
| NFTGuard | 0 | Not recorded | 68fa76f21e209131cea70273 |
| Mythril | 0 | Not recorded | 68fa76f21e209131cea70273 |
| Mythril | 0 | Not recorded | 68fa76f21e209131cea70273 |
| Mythril | 0 | Not recorded | 68fa76f21e209131cea70273 |
| Mythril | 0 | Not recorded | 68fa76f21e209131cea70273 |
| ERCx | 0 | Not recorded | 68fa76f21e209131cea70273 |
| ERCx | 0 | Not recorded | 68fa76f21e209131cea70273 |

### SymGPT

True Positives (TP): 157. Result ID: 69a80ca26dbb7075b94da213.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Total"}. This record does not assert independent reproduction.

### SymGPT

True Positives (TP): 76. Result ID: 69a80ca26dbb7075b94da212.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Low"}. This record does not assert independent reproduction.

### SymGPT

True Positives (TP): 53. Result ID: 69a80ca26dbb7075b94da211.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Medium"}. This record does not assert independent reproduction.

### Slither

True Positives (TP): 39. Result ID: 69a80ca26dbb7075b94da1fb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Total"}. This record does not assert independent reproduction.

### SymGPT

True Positives (TP): 28. Result ID: 69a80ca26dbb7075b94da210.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"High"}. This record does not assert independent reproduction.

### Slither

True Positives (TP): 26. Result ID: 69a80ca26dbb7075b94da1f9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Medium"}. This record does not assert independent reproduction.

### Slither

True Positives (TP): 13. Result ID: 69a80ca26dbb7075b94da1fa.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Low"}. This record does not assert independent reproduction.

### ERCx

True Positives (TP): 12. Result ID: 69a80ca26dbb7075b94da20d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Medium"}. This record does not assert independent reproduction.

### ERCx

True Positives (TP): 12. Result ID: 69a80ca26dbb7075b94da20f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Total"}. This record does not assert independent reproduction.

### ZepScope

True Positives (TP): 2. Result ID: 69a80ca26dbb7075b94da201.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Medium"}. This record does not assert independent reproduction.

### ZepScope

True Positives (TP): 2. Result ID: 69a80ca26dbb7075b94da203.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Total"}. This record does not assert independent reproduction.

### Slither

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da1f8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"High"}. This record does not assert independent reproduction.

### AChecker

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da1fc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"High"}. This record does not assert independent reproduction.

### AChecker

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da1fd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Medium"}. This record does not assert independent reproduction.

### AChecker

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da1fe.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Low"}. This record does not assert independent reproduction.

### AChecker

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da1ff.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Total"}. This record does not assert independent reproduction.

### ZepScope

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da200.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"High"}. This record does not assert independent reproduction.

### ZepScope

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da202.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Low"}. This record does not assert independent reproduction.

### NFTGuard

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da204.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70371e209131cea4998a.md>)

Recorded evaluation configuration: {"Severity Level":"High"}. This record does not assert independent reproduction.

### NFTGuard

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da205.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70371e209131cea4998a.md>)

Recorded evaluation configuration: {"Severity Level":"Medium"}. This record does not assert independent reproduction.

### NFTGuard

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da206.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70371e209131cea4998a.md>)

Recorded evaluation configuration: {"Severity Level":"Low"}. This record does not assert independent reproduction.

### NFTGuard

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da207.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70371e209131cea4998a.md>)

Recorded evaluation configuration: {"Severity Level":"Total"}. This record does not assert independent reproduction.

### Mythril

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da208.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"High"}. This record does not assert independent reproduction.

### Mythril

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da209.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Medium"}. This record does not assert independent reproduction.

### Mythril

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da20a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Low"}. This record does not assert independent reproduction.

### Mythril

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da20b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Total"}. This record does not assert independent reproduction.

### ERCx

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da20c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"High"}. This record does not assert independent reproduction.

### ERCx

True Positives (TP): 0. Result ID: 69a80ca26dbb7075b94da20e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76f21e209131cea70273.md>)

Recorded evaluation configuration: {"Severity Level":"Low"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
