Question Generation on SQuAD 1.1 (dev)
25.4BLEU-4ERNIE-GENLARGE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ERNIE-GENLARGEbeam size=52020.01 | 25.4 | 26.92 | 52.84 | |
| ERNIE-GENLARGEbeam size=12020.01 | 24.03 | 26.31 | 52.36 | |
| ERNIE-GENBASEbeam size=12020.01 | 22.28 | 25.13 | 50.58 | |
| UNILMLARGE2020.01 | 22.12 | 25.06 | 51.07 | |
| SemQG2020.01 | 20.76 | 24.2 | 48.91 | |
| NQG++Decoding=Beam search, Copy mechanism=true, Pre-trained GloVe=true, Shared embedding matrix=true2017.04 | 13.27 | — | — | |
| NQG+STshareDecoding=Beam search, Copy mechanism=true, Shared embedding matrix=true2017.04 | 12.92 | — | — | |
| NQG+PretrainDecoding=Beam search, Copy mechanism=true, Pre-trained GloVe=true2017.04 | 12.8 | — | — | |
| NQG+Decoding=Beam search, Copy mechanism=true2017.04 | 12.3 | — | — | |
| NQGDecoding=Beam search, Feature-rich encoder=true2017.04 | 10.06 | — | — | |
| NQG-CaseDecoding=Beam search, Word case feature=removed2017.04 | 9.91 | — | — | |
| NQG-POSDecoding=Beam search, POS tag feature=removed2017.04 | 9.83 | — | — | |
| NQG-NERDecoding=Beam search, NER feature=removed2017.04 | 9.5 | — | — | |
| PCFG-TransDecoding=Beam search, Type=Rule-based system2017.04 | 9.28 | — | — | |
| s2s+attDecoding=Beam search, Architecture=Seq2seq with attention2017.04 | 3.01 | — | — | |
| NQG-AnswerDecoding=Beam search, Answer position indicator=removed2017.04 | 2.79 | — | — |