Data-to-text generation on MLB (test)
99.9RG PrecisionTempl
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Templ2021.02 | 99.9 | — | — | — | — | — | 62.3 | 21.6 | 55.2 | 31 | 11 | 4.12 | — | |
| Templ2022.02 | 99.9 | — | — | — | — | — | 62.3 | 21.6 | 55.2 | 31 | 11 | 4.12 | — | |
| TemplType=Template-based generator2021.12 | 97.96 | — | — | — | 10.64 | — | — | 68.46 | 22.82 | — | — | 3.8 | 59.93 | |
| SeqPlan2022.02 | 95.9 | — | — | — | — | — | 28.9 | 43.3 | 53.5 | 47.8 | 22.7 | 14.29 | — | |
| SeqPlanvariant=w Oracle2022.02 | 95.9 | — | — | — | — | — | 27.6 | 42.5 | 50.4 | 46.1 | 22 | 13.13 | — | |
| SeqPlanvariant=2-Stage2022.02 | 95.9 | — | — | — | — | — | 28.6 | 41.4 | 50.8 | 45.6 | 21.3 | 13.96 | — | |
| Macroplanning=Macro Planning2021.02 | 94.4 | — | — | — | — | — | 30.8 | 40.8 | 54.9 | 46.8 | 21.8 | 12.62 | — | |
| Macro2022.02 | 94.4 | — | — | — | — | — | 30.8 | 40.8 | 54.9 | 46.8 | 21.8 | 12.62 | — | |
| Macrovariant=+Bin2022.02 | 93.7 | — | — | — | — | — | 31.2 | 38.3 | 52.4 | 44.2 | 21.6 | 12.32 | — | |
| -Plan(SP,4)planning=None2021.02 | 92.7 | — | — | — | — | — | 25.1 | 40 | 44.6 | 42.2 | 21.9 | 11.09 | — | |
| GOLDType=Ground Truth2021.12 | 92.07 | — | — | — | 98.76 | — | — | 98.84 | 99.91 | — | — | 100 | 21.02 | |
| ED+CC2021.02 | 91.3 | — | — | — | — | — | 32.5 | 27.8 | 40.6 | 33 | 17.1 | 9.68 | — | |
| ED+CC2022.02 | 91.3 | — | — | — | — | — | 32.5 | 27.8 | 40.6 | 33 | 17.1 | 9.68 | — | |
| SeqPlanvariant=w Uniform2022.02 | 90.9 | — | — | — | — | — | 18.5 | 36.5 | 30.6 | 33.3 | 14.5 | 10.3 | — | |
| force-copy-unkAbbreviation=FCU2021.12 | 84.5 | — | — | — | 21.16 | — | — | 49.39 | 50.89 | — | — | 10.5 | 21.05 | |
| force-copyAbbreviation=FC2021.12 | 82.5 | — | — | — | 19.28 | — | — | 46.91 | 49.01 | — | — | 10.4 | 21.71 | |
| RBF-2020Implementation=Re-implemented, Variant=dagger2021.12 | 81.71 | — | — | — | 19.37 | — | — | 47.75 | 47.11 | — | — | 9.7 | 19.53 | |
| NCP+CC2021.02 | 81.3 | — | — | — | — | — | 19.6 | 44.5 | 44.1 | 44.3 | 21.9 | 9.68 | — | |
| NCP+CC2022.02 | 81.3 | — | — | — | — | — | 19.6 | 44.5 | 44.1 | 44.3 | 21.9 | 9.68 | — | |
| ENT2021.02 | 81.1 | — | — | — | — | — | 23.8 | 40.9 | 49.5 | 44.8 | 20.7 | 11.5 | — | |
| ENT2022.02 | 81.1 | — | — | — | — | — | 23.8 | 40.9 | 49.5 | 44.8 | 20.7 | 11.5 | — | |
| PGNetImplementation=Re-implemented2021.12 | 79.12 | — | — | — | 20.07 | — | — | 47.06 | 47.73 | — | — | 9.9 | 20.94 | |
| ED+CC2019.06 | — | 3.24 | 0.4 | 0.22 | -0.9 | -2.47 | — | — | — | — | — | — | — | |
| ED+CC2021.02 | — | 3.42 | 0.72 | -22.5 | -12.08 | -39.17 | — | — | — | — | — | — | — | |
| ED+CC2022.02 | — | 3.42 | 0.72 | -32.5 | -18.33 | -48.33 | — | — | — | — | — | — | — | |
| ENT2019.06 | — | 2.86 | 0.52 | 8.31 | 6.07 | 5.39 | — | — | — | — | — | — | — | |
| ENT2021.02 | — | 3.71 | 0.73 | 5.83 | -0.83 | -22.08 | — | — | — | — | — | — | — | |
| Gold2019.06 | — | 2.81 | 0.15 | 1.24 | 3.48 | -9.33 | — | — | — | — | — | — | — | |
| Gold2021.02 | — | 3.59 | 0.14 | 21.67 | 30 | 26.67 | — | — | — | — | — | — | — | |
| Gold2022.02 | — | 3.59 | 0.14 | 21.67 | 29.17 | 14.17 | — | — | — | — | — | — | — | |
| Macro2021.02 | — | 3.76 | 0.25 | 46.25 | 26.67 | 27.08 | — | — | — | — | — | — | — | |
| Macro2022.02 | — | 3.76 | 0.25 | 37.5 | 15 | 22.5 | — | — | — | — | — | — | — | |
| NCP+CC2019.06 | — | 2.86 | 0.88 | 0.9 | -1.35 | -1.8 | — | — | — | — | — | — | — | |
| SeqPlan2022.02 | — | 3.68 | 0.19 | 31.67 | 22.5 | 2.5 | — | — | — | — | — | — | — | |
| Templ2021.02 | — | 4.21 | 0.04 | -51.25 | -43.75 | 7.5 | — | — | — | — | — | — | — | |
| Templ2022.02 | — | 4.21 | 0.04 | -58.33 | -48.33 | 9.17 | — | — | — | — | — | — | — | |
| TEMPL2019.06 | — | 3.98 | 0.04 | -10.67 | -7.3 | 8.43 | — | — | — | — | — | — | — |