Question Generation on SQuAD 1.1
0.2631METEORERNIE-GEN_LARGE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ERNIE-GEN_LARGEModel Size=Large2020.04 | 0.2631 | 0.2403 | 52.36 | — | |
| PALM_LARGEModel Size=Large2020.04 | 0.2585 | 0.2411 | 52.38 | — | |
| GLM410MParameters=410M2021.03 | 0.256 | 0.229 | 0.505 | — | |
| GLMSentObjective=Sentence-level2021.03 | 0.254 | 0.226 | 0.504 | — | |
| GLMLargeSize=Large2021.03 | 0.252 | 0.224 | 0.504 | — | |
| ERNIE2020.04 | 0.2513 | 0.2228 | 50.58 | — | |
| UniLMLargeSize=Large2021.03 | 0.251 | 0.221 | 0.511 | — | |
| UNILM2019.05 | 0.2506 | 0.2212 | 0.5107 | — | |
| PALMModel Size=Base2020.04 | 0.2502 | 0.2278 | 50.96 | — | |
| GLMDOCObjective=Document-level2021.03 | 0.25 | 0.223 | 0.502 | — | |
| UNILM2020.04 | 0.2494 | 0.2288 | 51.8 | — | |
| PATT-EG# Param.=363M, Speed=14.41, Backbone=M-BART2021.06 | 0.2431 | — | 0.4811 | 0.2027 | |
| M-BART# Param.=610M, Speed=12.62, Backbone=M-BART2021.06 | 0.2429 | — | 0.4807 | 0.202 | |
| SemQG2021.03 | 0.227 | 0.184 | 0.467 | — | |
| SemQG2019.05 | 0.2265 | 0.1837 | 0.4668 | — | |
| MP-GSN2020.04 | 0.2025 | 0.1638 | 44.48 | — | |
| CorefNQG2020.04 | 0.1912 | 0.1516 | — | — | |
| CorefNQG2019.05 | 0.1912 | 0.1516 | — | — | |
| PATT-EG# Param.=242M, Speed=27.86, Backbone=M-BERT2021.06 | 0.0986 | — | 0.2676 | 0.0355 | |
| M-BERT# Param.=382M, Speed=21.58, Backbone=M-BERT2021.06 | 0.0927 | — | 0.2588 | 0.0331 | |
| Random Init# Param.=382M, Speed=21.232021.06 | 0.0925 | — | 0.2398 | 0.0291 |