5W Question-Answer Generation on 5W QAG vs. 5W QA (val)
29.22BLEU5W framework (ProphetNet)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| 5W framework (ProphetNet)QAG Generator=ProphetNet, QA Validator=T5-3b, Input=Claim2023.05 | 29.22 | 48.13 | 35.26 | 35.66 | |
| 5W framework (ProphetNet)QAG Generator=ProphetNet, QA Validator=T5-Large, Input=Claim2023.05 | 28.81 | 48.02 | 37.81 | 38.03 | |
| 5W framework (ProphetNet)QAG Generator=ProphetNet, QA Validator=BERT large, Input=Claim2023.05 | 28.65 | 46.25 | 34.55 | 36.72 | |
| 5W framework (ProphetNet)QAG Generator=ProphetNet, QA Validator=T5-3b, Input=Claim + Paraphrase2023.05 | 28.13 | 46.18 | 34.15 | 36.62 | |
| 5W framework (ProphetNet)QAG Generator=ProphetNet, QA Validator=BERT large, Input=Claim + Paraphrase2023.05 | 27.27 | 44.1 | 32.95 | 35 | |
| 5W framework (BART)QAG Generator=BART, QA Validator=T5-3b, Input=Claim2023.05 | 21.78 | 34.53 | 28.03 | 28.07 | |
| 5W framework (ProphetNet)QAG Generator=ProphetNet, QA Validator=T5-Large, Input=Claim + Paraphrase2023.05 | 21.46 | 46.45 | 36.76 | 27.19 | |
| 5W framework (BART)QAG Generator=BART, QA Validator=T5-Large, Input=Claim2023.05 | 21.46 | 34.9 | 27.41 | 27.99 | |
| 5W framework (BART)QAG Generator=BART, QA Validator=T5-3b, Input=Claim + Paraphrase2023.05 | 20.93 | 33.57 | 27.65 | 27.24 | |
| 5W framework (BART)QAG Generator=BART, QA Validator=T5-Large, Input=Claim + Paraphrase2023.05 | 20.88 | 33.69 | 26.88 | 27.31 | |
| 5W framework (BART)QAG Generator=BART, QA Validator=BERT large, Input=Claim2023.05 | 20.66 | 33.19 | 25.51 | 26.44 | |
| 5W framework (BART)QAG Generator=BART, QA Validator=BERT large, Input=Claim + Paraphrase2023.05 | 19.74 | 32.34 | 25.14 | 25.71 |