Sentence Simplification on PWKP (test)
0LD (System -> Simple)GOLD
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GOLDtype=Reference2015.07 | 0 | 12.24 | 3 | 100 | 100 | 28 | 27.8 | 4.4 | — | — | — | — | |
| IdentitySimplification Strategy=Baseline2018.10 | 0 | — | — | 100 | 94.93 | 0 | — | — | 25.44 | 0 | 76.31 | 0 | |
| NarayanSupervision=Supervised2015.07 | 11.53 | 6.32 | 4 | 3 | 53.6 | 10 | 26.24 | 4.36 | — | — | — | — | |
| WubbenSupervision=Supervised2015.07 | 13.57 | 3.33 | 6 | 2 | 41.4 | 1 | 28.25 | 4.41 | — | — | — | — | |
| UNSUPSupervision=Unsupervised2015.07 | 14.29 | 6.75 | 3 | 0 | 38.47 | 49 | 26.22 | 4.4 | — | — | — | — | |
| ZhuSupervision=Supervised2015.07 | 14.64 | 7.87 | 2 | 0 | 37.4 | 80 | 24.21 | 4.38 | — | — | — | — | |
| WoodsendSupervision=Supervised2015.07 | 16.03 | 8.63 | 24 | 2 | 42 | 63 | 28.1 | 4.5 | — | — | — | — | |
| NTS-h1Simplification Strategy=Only MT-Based Simplification, Beam size=12018.10 | 17.13 | — | — | 66.02 | 88.67 | 0 | — | — | 28.73 | 0.8 | 70.95 | 14.45 | |
| SBMT-SARISimplification Strategy=Only MT-Based Simplification2018.10 | 23.31 | — | — | 4.18 | 74.44 | 0 | — | — | 41.46 | 6.77 | 69.92 | 47.68 | |
| NTS-h4Simplification Strategy=Only MT-Based Simplification, Beam size=42018.10 | 24.18 | — | — | 2.79 | 79.88 | 1 | — | — | 36.55 | 2.59 | 65.93 | 41.13 | |
| DSSSimplification Strategy=Only Structural Simplification2018.10 | 25.03 | — | — | 8.64 | 76.57 | 208 | — | — | 36.76 | 3.82 | 68.45 | 38.01 | |
| SEMosesSimplification Strategy=Structural+MT-Based Simplification2018.10 | 27.44 | — | — | 7.52 | 74.45 | 208 | — | — | 36.68 | 3.77 | 67.66 | 38.62 | |
| Simple WikipediaSimplification Strategy=Gold Reference2018.10 | 33.34 | — | — | 0 | 69.58 | 0 | — | — | 39.5 | 8.46 | 61.71 | 48.32 | |
| SENTS-h4Simplification Strategy=Structural+MT-Based Simplification, Beam size=42018.10 | 54.47 | — | — | 0.28 | 57.71 | 17 | — | — | 31.9 | 3.95 | 51.86 | 39.9 | |
| SENTS-h1Simplification Strategy=Structural+MT-Based Simplification, Beam size=12018.10 | 59.18 | — | — | 6.69 | 58.94 | 0 | — | — | 30.27 | 3.01 | 51.52 | 36.28 | |
| HYBRIDSimplification Strategy=Structural+MT-Based Simplification2018.10 | 61.53 | — | — | 1.39 | 52.82 | 3 | — | — | 27.4 | 2.41 | 43.09 | 36.69 |