List your company
ResearchFormerly WizWand

Abstractive Question Summarization on MATINF English translated subset (test)

48.17ROUGE-1ProphetNet + ROUGE-L
16.55424.76232.9741.178Jul 1, 2021
Updated 8mo ago

Evaluation results

MethodLinks
ProphetNet + ROUGE-Lcategory=Baseline, RL_reward=ROUGE-L2021.0748.1728.1348.66
ProphetNet + QTR + QFRcategory=Proposed Approach, reward=QTR + QFR2021.0747.7328.5449.33
ProphetNet + QFRcategory=Proposed Approach, reward=Question-focus recognition2021.0747.5328.2949.11
ProphetNet + QTRcategory=Proposed Approach, reward=Question-type identification2021.0747.5128.448.94
ProphetNet + Q-typecategory=Joint Learning2021.0747.1928.0248.7
ProphetNet + Q-type + Q-focuscategory=Joint Learning2021.0747.1828.0448.65
ProphetNet + Q-focuscategory=Joint Learning2021.0747.1428.0648.64
ProphetNetcategory=Baseline2021.0746.9427.7748.43
BART-LARGEcategory=Baseline2021.0742.5223.1343.98
PEGASUScategory=Baseline2021.0740.0523.6743.3
T5-BASEcategory=Baseline2021.0739.6621.2441.52
MINILMcategory=Baseline2021.0735.618.0838.7
BertSummcategory=Baseline2021.0731.1611.9434.7
SOTA*category=Baseline, implementation=trained on same data2021.0724.587.328.08
Pointer Generator (PG)category=Baseline2021.0723.317.0126.61
Transformercategory=Baseline2021.0722.255.8926.06
Seq2Seq + Attentioncategory=Baseline2021.0719.456.4523.77
Seq2Seqcategory=Baseline2021.0717.775.121.48