List your company

ResearchFormerly WizWand

AMR parsing

Benchmarks

DatasetSOTA methodMetricTrendResultsLast updated

LDC2017T10 AMR 2.0 (test)

Graphene Smatch

86.26Smatch

168

Feb 26, 2026

86.5SMATCH

45

Feb 26, 2026

81.7Smatch

45

Feb 26, 2026

LDC2014T12 (Full)

Goodman et al. (2016)

70F1 Score

32

Feb 26, 2026

LDC2014T12 Newswire section

Transition-based AMR Parser

73.3F1 Score

27

Feb 26, 2026

AMR 1.0 LDC2014T12 (test)

75.4SMATCH F1

23

Feb 26, 2026

LDC2015E86 (test)

5 bi-LSTM networks (word-based)

70.7F1 Score

21

Feb 26, 2026

Struct-BART + MBSE-G silver + gold

81.3Smatch Score

17

Feb 26, 2026

AMR 3.0 LDC2020T02 (test)

AMRBART (large)

84.2Smatch Labeled

14

Feb 26, 2026

QALD-9-AMR (test)

Struct-BART + MBSE-G silver + gold

90.1Smatch

8

Feb 26, 2026

Graphene Smatch

79.52Smatch

8

Feb 26, 2026

Graphene Smatch

76.32Smatch

8

Feb 26, 2026

Graphene Smatch

62.8Smatch

8

Feb 26, 2026

LDC2015E86 (dev)

69F1 Score

7

Feb 26, 2026

LDC2017T10 (test)

74.4Smatch (ordinary)

6

Feb 26, 2026

LDC2015E86 R1 (test)

neural AMR parser with latent alignment

73.7Smatch

6

Feb 26, 2026

82.6Smatch Score

5

Feb 26, 2026

LDC2016E25 2.0 (test)

neural AMR parser with latent alignment

74.4Smatch Score

4

Feb 26, 2026

LDC2014T12 (test)

66.3F-score

1

Feb 26, 2026

LDC2013E117 1.0 (test)

58F-score

1

Feb 26, 2026