# AMR Parsing on LDC2017T10 AMR 2.0 (test)

Source: [AMR Parsing on LDC2017T10 AMR 2.0 (test)](<https://www.sota2.com/research/sota/amr-parsing-on-ldc2017t10-amr-2-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:04:26.449Z

Evaluation of Abstract Meaning Representation (AMR) parsing performance on the test split of the LDC2017T10 AMR 2.0 dataset, covering detailed metrics like Smatch, Concepts, and SRL.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | AMR Parsing |
| Dataset (including any stated split) | LDC2017T10 AMR 2.0 (test) |
| Metric | Smatch |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 205 of 205 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Smatch](<https://www.sota2.com/research/sota/amr-parsing-on-ldc2017t10-amr-2-0-test.md?metric=Smatch>): Higher is better; unit: PERCENT.

- [Unlabeled Structure Score](<https://www.sota2.com/research/sota/amr-parsing-on-ldc2017t10-amr-2-0-test.md?metric=Unlabeled%20Structure%20Score>): Higher is better; unit: PERCENT.

- [No WSD Score](<https://www.sota2.com/research/sota/amr-parsing-on-ldc2017t10-amr-2-0-test.md?metric=No%20WSD%20Score>): Higher is better; unit: PERCENT.

- [Named Entities Score](<https://www.sota2.com/research/sota/amr-parsing-on-ldc2017t10-amr-2-0-test.md?metric=Named%20Entities%20Score>): Higher is better; unit: PERCENT.

- [Wikification Score](<https://www.sota2.com/research/sota/amr-parsing-on-ldc2017t10-amr-2-0-test.md?metric=Wikification%20Score>): Higher is better; unit: PERCENT.

- [Negations Score](<https://www.sota2.com/research/sota/amr-parsing-on-ldc2017t10-amr-2-0-test.md?metric=Negations%20Score>): Higher is better; unit: PERCENT.

- [Concepts Score](<https://www.sota2.com/research/sota/amr-parsing-on-ldc2017t10-amr-2-0-test.md?metric=Concepts%20Score>): Higher is better; unit: PERCENT.

- [Reentrancies Score](<https://www.sota2.com/research/sota/amr-parsing-on-ldc2017t10-amr-2-0-test.md?metric=Reentrancies%20Score>): Higher is better; unit: PERCENT.

- [SRL Score](<https://www.sota2.com/research/sota/amr-parsing-on-ldc2017t10-amr-2-0-test.md?metric=SRL%20Score>): Higher is better; unit: PERCENT.

- [Precision](<https://www.sota2.com/research/sota/amr-parsing-on-ldc2017t10-amr-2-0-test.md?metric=Precision>): Higher is better; unit: PERCENT.

- [Recall](<https://www.sota2.com/research/sota/amr-parsing-on-ldc2017t10-amr-2-0-test.md?metric=Recall>): Higher is better; unit: PERCENT.

- [F1 Score](<https://www.sota2.com/research/sota/amr-parsing-on-ldc2017t10-amr-2-0-test.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

- [Smatch Labeled](<https://www.sota2.com/research/sota/amr-parsing-on-ldc2017t10-amr-2-0-test.md?metric=Smatch%20Labeled>): Higher is better; unit: PERCENT.

- [Smatch Unlabeled](<https://www.sota2.com/research/sota/amr-parsing-on-ldc2017t10-amr-2-0-test.md?metric=Smatch%20Unlabeled>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Smatch | Result date | Report paper |
| --- | --- | --- | --- |
| Graphene Smatch | 86.26 | Not recorded | 68fa6ba71e209131cea2f9aa |
| LeakDistill | 86.1 | Not recorded | 68fa6fd91e209131cea47989 |
| Barzdins | 85.93 | Not recorded | 68fa6ba71e209131cea2f9aa |
| Struct-BART + MBSE-A silver1+2+3 + ensemble dec. | 85.9 | Not recorded | 68fa6c761e209131cea340da |
| Graphene Support | 85.85 | Not recorded | 68fa6ba71e209131cea2f9aa |
| Struct-BART + MBSE-G silver1+2+3 + ensemble dec. | 85.7 | Not recorded | 68fa6c761e209131cea340da |
| LeakDistill | 85.7 | Not recorded | 68fa6fd91e209131cea47989 |
| Struct-BART + MBSE-G silver1+2+3 + ensemble dec. | 85.6 | Not recorded | 68fa6c761e209131cea340da |
| Bai et al. | 85.4 | Not recorded | 68fa6c761e209131cea340da |
| AMRBART (large) | 85.4 | Not recorded | 68fa6c7f1e209131cea34552 |
| AMRBART | 85.4 | Not recorded | 68fa6fd91e209131cea47989 |
| ATP | 85.2 | Not recorded | 68fa6fd91e209131cea47989 |
| StructBART-J ensem. | 84.9 | Not recorded | 68fa6b2c1e209131cea2c915 |
| Structured-BART-baseline + self-trained silver1 + ensemble dec. | 84.9 | Not recorded | 68fa6c761e209131cea340da |
| Ancestor | 84.8 | Not recorded | 68fa6fd91e209131cea47989 |
| Graphene 4S | 84.78 | Not recorded | 68fa6ba71e209131cea2f9aa |
| StructBART-J | 84.7 | Not recorded | 68fa6b2c1e209131cea2c915 |
| Structured-BART-baseline + self-trained silver1 | 84.7 | Not recorded | 68fa6c761e209131cea340da |
| BiBL | 84.6 | Not recorded | 68fa6fd91e209131cea47989 |
| Bevilacqua et al. (2021) | 84.5 | Not recorded | 68fa6b2c1e209131cea2c915 |
| Bevilacqua et al. | 84.5 | Not recorded | 68fa6c761e209131cea340da |
| Bevilacqua+ (2021, large) | 84.5 | Not recorded | 68fa6c7f1e209131cea34552 |
| SPRING (ours) | 84.4 | Not recorded | 68fa6fd91e209131cea47989 |
| Bevilacqua et al. | 84.3 | Not recorded | 68fa69ee1e209131cea2503e |
| Bevilacqua et al. (2021) | 84.3 | Not recorded | 68fa6b2c1e209131cea2c915 |
| Bevilacqua+ (2021, large) | 84.3 | Not recorded | 68fa6c7f1e209131cea34552 |
| SPRING | 84.3 | Not recorded | 68fa6fd91e209131cea47989 |
| SPRING | 84.22 | Not recorded | 68fa6ba71e209131cea2f9aa |
| StructBART-J | 84.2 | Not recorded | 68fa6b2c1e209131cea2c915 |
| Xia et al. | 84.2 | Not recorded | 68fa6c761e209131cea340da |
| Structured-BART-baseline | 84.2 | Not recorded | 68fa6c761e209131cea340da |
| StructBART-S | 84 | Not recorded | 68fa6b2c1e209131cea2c915 |
| Structured-BART-baseline | 84 | Not recorded | 68fa6c761e209131cea340da |
| Bevilacqua et al. | 83.8 | Not recorded | 68fa69ee1e209131cea2503e |
| Bevilacqua et al. (2021) | 83.8 | Not recorded | 68fa6b2c1e209131cea2c915 |
| AMRBART (base) | 83.6 | Not recorded | 68fa6c7f1e209131cea34552 |
| APT base | 83.4 | Not recorded | 68fa69ee1e209131cea2503e |
| T5 | 82.98 | Not recorded | 68fa6ba71e209131cea2f9aa |
| APT base | 82.8 | Not recorded | 68fa69ee1e209131cea2503e |
| APT base | 82.8 | Not recorded | 68fa69ee1e209131cea2503e |
| APT | 82.7 | Not recorded | 68fa6ba71e209131cea2f9aa |
| Bevilacqua+ (2021, base) | 82.7 | Not recorded | 68fa6c7f1e209131cea34552 |
| Zhou et al. (2021) | 82.6 | Not recorded | 68fa6b2c1e209131cea2c915 |
| Zhou et al. | 82.6 | Not recorded | 68fa6c761e209131cea340da |
| APT small | 82.5 | Not recorded | 68fa69ee1e209131cea2503e |
| APT base | 81.8 | Not recorded | 68fa69ee1e209131cea2503e |
| APT small | 81.7 | Not recorded | 68fa69ee1e209131cea2503e |
| Zhou et al. (2021) | 81.7 | Not recorded | 68fa6b2c1e209131cea2c915 |
| Xu et al. (2020) | 81.4 | Not recorded | 68fa6b2c1e209131cea2c915 |
| Xu et al. | 81.4 | Not recorded | 68fa6c761e209131cea340da |
| mining + synTxt + synAMR | 81.3 | Not recorded | 68fa68881e209131cea1cba6 |
| Lee et al. | 81.3 | Not recorded | 68fa69ee1e209131cea2503e |
| Lee et al. (2020) | 81.3 | Not recorded | 68fa6b2c1e209131cea2c915 |
| Lee et al. | 81.3 | Not recorded | 68fa6c761e209131cea340da |
| synAMR | 81 | Not recorded | 68fa68881e209131cea1cba6 |
| synTxt + synAMR | 81 | Not recorded | 68fa68881e209131cea1cba6 |
| mining + synAMR | 80.9 | Not recorded | 68fa68881e209131cea1cba6 |
| synTxt | 80.7 | Not recorded | 68fa68881e209131cea1cba6 |
| mining + synTxt | 80.4 | Not recorded | 68fa68881e209131cea1cba6 |
| oracle mining | 80.3 | Not recorded | 68fa68881e209131cea1cba6 |
| AMR-gs | 80.2 | Not recorded | 68fa676e1e209131cea16266 |
| Cai and Lam | 80.2 | Not recorded | 68fa68881e209131cea1cba5 |
| Cai and Lam | 80.2 | Not recorded | 68fa68881e209131cea1cba6 |
| F. A. et al. + SE^R | 80.2 | Not recorded | 68fa68881e209131cea1cba6 |
| Cai and Lam | 80.2 | Not recorded | 68fa69ee1e209131cea2503e |
| Astudillo et al. | 80.2 | Not recorded | 68fa69ee1e209131cea2503e |
| Xu et al. | 80.2 | Not recorded | 68fa69ee1e209131cea2503e |
| Cai and Lam (2020) | 80.2 | Not recorded | 68fa6b2c1e209131cea2c915 |
| Astudillo et al. (2020) | 80.2 | Not recorded | 68fa6b2c1e209131cea2c915 |
| Cai and Lam | 80.2 | Not recorded | 68fa6c761e209131cea340da |
| Fernandez Astudillo et al. | 80.2 | Not recorded | 68fa6c761e209131cea340da |
| CaiL (2020a) | 80.2 | Not recorded | 68fa6c7f1e209131cea34552 |
| Xu+ (2020) | 80.2 | Not recorded | 68fa6c7f1e209131cea34552 |
| Lee20 | 80.2 | Not recorded | 68fa6db91e209131cea3b978 |
| Cai20 w/ rules | 80.2 | Not recorded | 68fa6db91e209131cea3b978 |
| Xu20 | 80.2 | Not recorded | 68fa6db91e209131cea3b978 |
| Cai&Lam | 80.15 | Not recorded | 68fa6ba71e209131cea2f9aa |
| Stack-Transformer | 79 | Not recorded | 68fa68881e209131cea1cba5 |
| F. A. et al. | 79 | Not recorded | 68fa68881e209131cea1cba6 |
| Stack-Transformer | 78.8 | Not recorded | 68fa68881e209131cea1cba5 |

### Graphene Smatch

Smatch: 86.26. Result ID: 698e9ceeffc3901de09f270a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ba71e209131cea2f9aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ba71e209131cea2f9aa.md>)

[Implementation](<https://github.com/IBM/graph_ensemble_learning>)

Recorded evaluation configuration: {"ensemble":"SPRING(4), APT, T5, Cai&Lam","aggregation":"Smatch"}. This record does not assert independent reproduction.

### LeakDistill

Smatch: 86.1. Result ID: 6990ee183a6c314849045fee.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fd91e209131cea47989.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fd91e209131cea47989.md>)

[Implementation](<http://www.github.com/sapienzanlp/LeakDistill>)

Recorded evaluation configuration: {"Extra Data":"140K"}. This record does not assert independent reproduction.

### Barzdins

Smatch: 85.93. Result ID: 698e9ceeffc3901de09f2709.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ba71e209131cea2f9aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62691e209131ce9f93c8.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Struct-BART + MBSE-A silver1+2+3 + ensemble dec.

Smatch: 85.9. Result ID: 698f14df3a6c314849f59dae.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/tree/structured-mbart>)

Recorded evaluation configuration: {"vocabulary":"joint","silver":"219K","distillation":"Ensemble-5","ensemble-decoding":"true"}. This record does not assert independent reproduction.

### Graphene Support

Smatch: 85.85. Result ID: 698e9ceeffc3901de09f2708.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ba71e209131cea2f9aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ba71e209131cea2f9aa.md>)

[Implementation](<https://github.com/IBM/graph_ensemble_learning>)

Recorded evaluation configuration: {"ensemble":"SPRING(4), APT, T5, Cai&Lam","aggregation":"Support"}. This record does not assert independent reproduction.

### Struct-BART + MBSE-G silver1+2+3 + ensemble dec.

Smatch: 85.7. Result ID: 698f14df3a6c314849f59dad.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/tree/structured-mbart>)

Recorded evaluation configuration: {"vocabulary":"joint","silver":"219K","distillation":"Ensemble-4","ensemble-decoding":"true"}. This record does not assert independent reproduction.

### LeakDistill

Smatch: 85.7. Result ID: 6990ee183a6c314849045fea.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fd91e209131cea47989.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fd91e209131cea47989.md>)

[Implementation](<http://www.github.com/sapienzanlp/LeakDistill>)

Recorded evaluation configuration: {"Extra Data":"None"}. This record does not assert independent reproduction.

### Struct-BART + MBSE-G silver1+2+3 + ensemble dec.

Smatch: 85.6. Result ID: 698f14df3a6c314849f59dac.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/tree/structured-mbart>)

Recorded evaluation configuration: {"vocabulary":"separate","silver":"219K","distillation":"Ensemble-4","ensemble-decoding":"true"}. This record does not assert independent reproduction.

### Bai et al.

Smatch: 85.4. Result ID: 698f14df3a6c314849f59da7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c7f1e209131cea34552.md>)

[Implementation](<https://github.com/muyeby/AMRBART>)

Recorded evaluation configuration: {"silver":"200K"}. This record does not assert independent reproduction.

### AMRBART (large)

Smatch: 85.4. Result ID: 698f1be43a6c314849f5e0ff.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c7f1e209131cea34552.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c7f1e209131cea34552.md>)

[Implementation](<https://github.com/muyeby/AMRBART>)

Recorded evaluation configuration: {"Pre-trained":true,"Model size":"large"}. This record does not assert independent reproduction.

### AMRBART

Smatch: 85.4. Result ID: 6990ee183a6c314849045fed.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fd91e209131cea47989.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/tree/structured-mbart>)

Recorded evaluation configuration: {"Extra Data":"200K"}. This record does not assert independent reproduction.

### ATP

Smatch: 85.2. Result ID: 6990ee183a6c314849045fec.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fd91e209131cea47989.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c531e209131cea33458.md>)

Recorded evaluation configuration: {"Extra Data":"40K"}. This record does not assert independent reproduction.

### StructBART-J ensem.

Smatch: 84.9. Result ID: 698e680fffc3901de09d5414.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: {"Pre-trained Model":"BART","Fine-tuning":true,"Ensemble Decoding":true,"Vocabulary Strategy":"Joint"}. This record does not assert independent reproduction.

### Structured-BART-baseline + self-trained silver1 + ensemble dec.

Smatch: 84.9. Result ID: 698f14df3a6c314849f59dab.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: {"vocabulary":"separate","silver":"90K","ensemble-decoding":"true"}. This record does not assert independent reproduction.

### Ancestor

Smatch: 84.8. Result ID: 6990ee183a6c314849045fe9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fd91e209131cea47989.md>)

Recorded evaluation configuration: {"Extra Data":"None"}. This record does not assert independent reproduction.

### Graphene 4S

Smatch: 84.78. Result ID: 698e9ceeffc3901de09f2707.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ba71e209131cea2f9aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ba71e209131cea2f9aa.md>)

[Implementation](<https://github.com/IBM/graph_ensemble_learning>)

Recorded evaluation configuration: {"ensemble":"4 SPRING checkpoints"}. This record does not assert independent reproduction.

### StructBART-J

Smatch: 84.7. Result ID: 698e680fffc3901de09d5413.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: {"Pre-trained Model":"BART","Fine-tuning":true,"Extra Data":"47K","Train Align.":true,"Vocabulary Strategy":"Joint"}. This record does not assert independent reproduction.

### Structured-BART-baseline + self-trained silver1

Smatch: 84.7. Result ID: 698f14df3a6c314849f59daa.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: {"vocabulary":"separate","silver":"90K"}. This record does not assert independent reproduction.

### BiBL

Smatch: 84.6. Result ID: 6990ee183a6c314849045fe8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fd91e209131cea47989.md>)

Recorded evaluation configuration: {"Extra Data":"None"}. This record does not assert independent reproduction.

### Bevilacqua et al. (2021)

Smatch: 84.5. Result ID: 698e680fffc3901de09d540b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

Recorded evaluation configuration: {"Pre-trained Model":"BART","Fine-tuning":true,"Collapse Subgraph":"G.R.","External Dependency (Lemm.)":true}. This record does not assert independent reproduction.

### Bevilacqua et al.

Smatch: 84.5. Result ID: 698f14df3a6c314849f59da4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

Recorded evaluation configuration: {"silver":"200K"}. This record does not assert independent reproduction.

### Bevilacqua+ (2021, large)

Smatch: 84.5. Result ID: 698f1be43a6c314849f5e0fc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c7f1e209131cea34552.md>)

Recorded evaluation configuration: {"Pre-trained":true,"Model size":"large"}. This record does not assert independent reproduction.

### SPRING (ours)

Smatch: 84.4. Result ID: 6990ee183a6c314849045fe7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fd91e209131cea47989.md>)

Recorded evaluation configuration: {"Extra Data":"None"}. This record does not assert independent reproduction.

### Bevilacqua et al.

Smatch: 84.3. Result ID: 698df5fcffc3901de099c6e1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

Recorded evaluation configuration: {"training\_data":"200K silver"}. This record does not assert independent reproduction.

### Bevilacqua et al. (2021)

Smatch: 84.3. Result ID: 698e680fffc3901de09d540f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

Recorded evaluation configuration: {"Pre-trained Model":"BART","Fine-tuning":true,"Extra Data":"200K"}. This record does not assert independent reproduction.

### Bevilacqua+ (2021, large)

Smatch: 84.3. Result ID: 698f1be43a6c314849f5e0fd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c7f1e209131cea34552.md>)

Recorded evaluation configuration: {"Pre-trained":true,"Model size":"large","Silver data fine-tuning":true}. This record does not assert independent reproduction.

### SPRING

Smatch: 84.3. Result ID: 6990ee183a6c314849045feb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fd91e209131cea47989.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/tree/structured-mbart>)

Recorded evaluation configuration: {"Extra Data":"200K"}. This record does not assert independent reproduction.

### SPRING

Smatch: 84.22. Result ID: 698e9ceeffc3901de09f2703.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ba71e209131cea2f9aa.md>)

Recorded evaluation configuration: {"selection\_criteria":"highest Smatch among 4 random seeds"}. This record does not assert independent reproduction.

### StructBART-J

Smatch: 84.2. Result ID: 698e680fffc3901de09d5412.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: {"Pre-trained Model":"BART","Fine-tuning":true,"Vocabulary Strategy":"Joint"}. This record does not assert independent reproduction.

### Xia et al.

Smatch: 84.2. Result ID: 698f14df3a6c314849f59da6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

Recorded evaluation configuration: {"silver":"1.8M"}. This record does not assert independent reproduction.

### Structured-BART-baseline

Smatch: 84.2. Result ID: 698f14df3a6c314849f59da9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: {"vocabulary":"joint"}. This record does not assert independent reproduction.

### StructBART-S

Smatch: 84. Result ID: 698e680fffc3901de09d5411.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: {"Pre-trained Model":"BART","Fine-tuning":true,"Vocabulary Strategy":"Separate"}. This record does not assert independent reproduction.

### Structured-BART-baseline

Smatch: 84. Result ID: 698f14df3a6c314849f59da8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: {"vocabulary":"separate"}. This record does not assert independent reproduction.

### Bevilacqua et al.

Smatch: 83.8. Result ID: 698df5fcffc3901de099c6de.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Bevilacqua et al. (2021)

Smatch: 83.8. Result ID: 698e680fffc3901de09d540a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

Recorded evaluation configuration: {"Pre-trained Model":"BART","Fine-tuning":true,"External Dependency (Lemm.)":true}. This record does not assert independent reproduction.

### AMRBART (base)

Smatch: 83.6. Result ID: 698f1be43a6c314849f5e0fe.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c7f1e209131cea34552.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c7f1e209131cea34552.md>)

[Implementation](<https://github.com/muyeby/AMRBART>)

Recorded evaluation configuration: {"Pre-trained":true,"Model size":"base"}. This record does not assert independent reproduction.

### APT base

Smatch: 83.4. Result ID: 698df5fcffc3901de099c6e7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: {"backbone":"RoBERTa","training\_data":"70K silver","decoding":"partial ensemble"}. This record does not assert independent reproduction.

### T5

Smatch: 82.98. Result ID: 698e9ceeffc3901de09f2705.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ba71e209131cea2f9aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa709e1e209131cea4c470.md>)

[Implementation](<https://github.com/google-research/text-to-text-transfer-transformer>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### APT base

Smatch: 82.8. Result ID: 698df5fcffc3901de099c6e5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: {"backbone":"RoBERTa","decoding":"partial ensemble"}. This record does not assert independent reproduction.

### APT base

Smatch: 82.8. Result ID: 698df5fcffc3901de099c6e6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: {"backbone":"RoBERTa","training\_data":"70K silver"}. This record does not assert independent reproduction.

### APT

Smatch: 82.7. Result ID: 698e9ceeffc3901de09f2704.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ba71e209131cea2f9aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Bevilacqua+ (2021, base)

Smatch: 82.7. Result ID: 698f1be43a6c314849f5e0fb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c7f1e209131cea34552.md>)

Recorded evaluation configuration: {"Pre-trained":true,"Model size":"base"}. This record does not assert independent reproduction.

### Zhou et al. (2021)

Smatch: 82.6. Result ID: 698e680fffc3901de09d5410.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: {"Pre-trained Model":"RoBERTa","Collapse Subgraph":"S.A.","External Dependency (NER)":true,"Extra Data":"70K","Train Align.":true}. This record does not assert independent reproduction.

### Zhou et al.

Smatch: 82.6. Result ID: 698f14df3a6c314849f59da5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

Recorded evaluation configuration: {"year":"2021a","silver":"70K"}. This record does not assert independent reproduction.

### APT small

Smatch: 82.5. Result ID: 698df5fcffc3901de099c6e4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: {"backbone":"RoBERTa","decoding":"partial ensemble"}. This record does not assert independent reproduction.

### APT base

Smatch: 81.8. Result ID: 698df5fcffc3901de099c6e3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: {"backbone":"RoBERTa"}. This record does not assert independent reproduction.

### APT small

Smatch: 81.7. Result ID: 698df5fcffc3901de099c6e2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: {"backbone":"RoBERTa"}. This record does not assert independent reproduction.

### Zhou et al. (2021)

Smatch: 81.7. Result ID: 698e680fffc3901de09d540c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser>)

Recorded evaluation configuration: {"Pre-trained Model":"RoBERTa","Collapse Subgraph":"S.A.","External Dependency (NER)":true}. This record does not assert independent reproduction.

### Xu et al. (2020)

Smatch: 81.4. Result ID: 698e680fffc3901de09d540d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68711e209131cea1c437.md>)

[Implementation](<https://github.com/xdqkid/S2S-AMR-Parser>)

Recorded evaluation configuration: {"Pre-trained Model":"Custom","Fine-tuning":true,"Extra Data":"4M"}. This record does not assert independent reproduction.

### Xu et al.

Smatch: 81.4. Result ID: 698f14df3a6c314849f59da3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68711e209131cea1c437.md>)

[Implementation](<https://github.com/xdqkid/S2S-AMR-Parser>)

Recorded evaluation configuration: {"silver":"14M"}. This record does not assert independent reproduction.

### mining + synTxt + synAMR

Smatch: 81.3. Result ID: 698d758f8b517eb43321a719.

[Reporting paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: {"synthetic data source":"unlabeled text"}. This record does not assert independent reproduction.

### Lee et al.

Smatch: 81.3. Result ID: 698df5fcffc3901de099c6e0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: {"backbone":"RoBERTa","training\_data":"85K silver"}. This record does not assert independent reproduction.

### Lee et al. (2020)

Smatch: 81.3. Result ID: 698e680fffc3901de09d540e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: {"Pre-trained Model":"RoBERTa","Collapse Subgraph":"S.A.","External Dependency (NER)":true,"Extra Data":"85K","Train Align.":true}. This record does not assert independent reproduction.

### Lee et al.

Smatch: 81.3. Result ID: 698f14df3a6c314849f59da2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: {"silver":"85K"}. This record does not assert independent reproduction.

### synAMR

Smatch: 81. Result ID: 698d758f8b517eb43321a715.

[Reporting paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: {"synthetic data source":"unlabeled text"}. This record does not assert independent reproduction.

### synTxt + synAMR

Smatch: 81. Result ID: 698d758f8b517eb43321a718.

[Reporting paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: {"synthetic data source":"unlabeled text"}. This record does not assert independent reproduction.

### mining + synAMR

Smatch: 80.9. Result ID: 698d758f8b517eb43321a717.

[Reporting paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: {"synthetic data source":"unlabeled text"}. This record does not assert independent reproduction.

### synTxt

Smatch: 80.7. Result ID: 698d758f8b517eb43321a714.

[Reporting paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### mining + synTxt

Smatch: 80.4. Result ID: 698d758f8b517eb43321a716.

[Reporting paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### oracle mining

Smatch: 80.3. Result ID: 698d758f8b517eb43321a713.

[Reporting paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### AMR-gs

Smatch: 80.2. Result ID: 698d343e8b517eb4331fc62a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa676e1e209131cea16266.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa676e1e209131cea16266.md>)

[Implementation](<https://github.com/jcyk/AMR-gs>)

Recorded evaluation configuration: {"Graph Re-categorization":true,"BERT":true}. This record does not assert independent reproduction.

### Cai and Lam

Smatch: 80.2. Result ID: 698d75718b517eb43321a695.

[Reporting paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa676e1e209131cea16266.md>)

[Implementation](<https://github.com/jcyk/AMR-gs>)

Recorded evaluation configuration: {"Graph Recategorization":true,"Embeddings":"RoBERTa"}. This record does not assert independent reproduction.

### Cai and Lam

Smatch: 80.2. Result ID: 698d758f8b517eb43321a711.

[Reporting paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa676e1e209131cea16266.md>)

[Implementation](<https://github.com/jcyk/AMR-gs>)

Recorded evaluation configuration: {"BERT":"base","Graph Recategorization":true}. This record does not assert independent reproduction.

### F. A. et al. + SE^R

Smatch: 80.2. Result ID: 698d758f8b517eb43321a712.

[Reporting paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba5.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: {"Backbone":"stack-Transformer"}. This record does not assert independent reproduction.

### Cai and Lam

Smatch: 80.2. Result ID: 698df5fcffc3901de099c6dc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

Recorded evaluation configuration: {"backbone":"BERT","graph re-categorization":true}. This record does not assert independent reproduction.

### Astudillo et al.

Smatch: 80.2. Result ID: 698df5fcffc3901de099c6dd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba5.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: {"backbone":"RoBERTa"}. This record does not assert independent reproduction.

### Xu et al.

Smatch: 80.2. Result ID: 698df5fcffc3901de099c6df.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69ee1e209131cea2503e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68711e209131cea1c437.md>)

[Implementation](<https://github.com/xdqkid/S2S-AMR-Parser>)

Recorded evaluation configuration: {"training\_data":"4M silver"}. This record does not assert independent reproduction.

### Cai and Lam (2020)

Smatch: 80.2. Result ID: 698e680fffc3901de09d5407.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa676e1e209131cea16266.md>)

[Implementation](<https://github.com/jcyk/AMR-gs>)

Recorded evaluation configuration: {"Pre-trained Model":"BERT","Collapse Subgraph":"G.R."}. This record does not assert independent reproduction.

### Astudillo et al. (2020)

Smatch: 80.2. Result ID: 698e680fffc3901de09d5408.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c915.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba5.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: {"Pre-trained Model":"RoBERTa","Collapse Subgraph":"S.A.","External Dependency (NER)":true}. This record does not assert independent reproduction.

### Cai and Lam

Smatch: 80.2. Result ID: 698f14df3a6c314849f59da0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa676e1e209131cea16266.md>)

[Implementation](<https://github.com/jcyk/AMR-gs>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Fernandez Astudillo et al.

Smatch: 80.2. Result ID: 698f14df3a6c314849f59da1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c761e209131cea340da.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba5.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### CaiL (2020a)

Smatch: 80.2. Result ID: 698f1be43a6c314849f5e0f9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c7f1e209131cea34552.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa676e1e209131cea16266.md>)

[Implementation](<https://github.com/jcyk/AMR-gs>)

Recorded evaluation configuration: {"Pre-trained":true}. This record does not assert independent reproduction.

### Xu+ (2020)

Smatch: 80.2. Result ID: 698f1be43a6c314849f5e0fa.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c7f1e209131cea34552.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68711e209131cea1c437.md>)

[Implementation](<https://github.com/xdqkid/S2S-AMR-Parser>)

Recorded evaluation configuration: {"Pre-trained":true}. This record does not assert independent reproduction.

### Lee20

Smatch: 80.2. Result ID: 698fe1723a6c314849fc845f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6db91e209131cea3b978.md>)

Recorded evaluation configuration: {"Hand-crafted rules":true,"Specialized pretraining":true}. This record does not assert independent reproduction.

### Cai20 w/ rules

Smatch: 80.2. Result ID: 698fe1723a6c314849fc8460.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6db91e209131cea3b978.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa676e1e209131cea16266.md>)

[Implementation](<https://github.com/jcyk/AMR-gs>)

Recorded evaluation configuration: {"Hand-crafted rules":true,"Specialized pretraining":true}. This record does not assert independent reproduction.

### Xu20

Smatch: 80.2. Result ID: 698fe1723a6c314849fc8462.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6db91e209131cea3b978.md>)

Recorded evaluation configuration: {"Hand-crafted rules":false,"Specialized pretraining":true}. This record does not assert independent reproduction.

### Cai&Lam

Smatch: 80.15. Result ID: 698e9ceeffc3901de09f2706.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ba71e209131cea2f9aa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa676e1e209131cea16266.md>)

[Implementation](<https://github.com/jcyk/AMR-gs>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Stack-Transformer

Smatch: 79. Result ID: 698d75718b517eb43321a69a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba5.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: {"Attention Modification":"Full","Variant":"c"}. This record does not assert independent reproduction.

### F. A. et al.

Smatch: 79. Result ID: 698d758f8b517eb43321a70f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba5.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Stack-Transformer

Smatch: 78.8. Result ID: 698d75718b517eb43321a699.

[Reporting paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cba5.md>)

[Implementation](<https://github.com/IBM/transition-amr-parser/>)

Recorded evaluation configuration: {"Attention Modification":"buffer only","Variant":"e"}. This record does not assert independent reproduction.

Page 1 of 3. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/sota/amr-parsing-on-ldc2017t10-amr-2-0-test.md?metric=Smatch&page=2>): Follow this link to discover more pages.
