Abstractive Summarization on New York Times F1 variants of Rouge (test)
48.08ROUGE-1DCA MLE+SEM+RL, mpgen, with-comm, with caa (m7)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DCA MLE+SEM+RL, mpgen, with-comm, with caa (m7)Loss=MLE+SEM+RL, Pointer=mpgen, Communication=with-comm, Attention=caa, Agents=32018.03 | 48.08 | 31.19 | 42.33 | |
| DCA MLE+SEM, mpgen, with-comm, with caa (m6)Loss=MLE+SEM, Pointer=mpgen, Communication=with-comm, Attention=caa, Agents=32018.03 | 47.3 | 30.5 | 41.06 | |
| RL, no intra-attentionintra-attention=false, training=RL2018.03 | 47.22 | 30.51 | 43.27 | |
| ML+RL, no intra-attentionintra-attention=false, training=ML+RL2018.03 | 47.03 | 30.72 | 43.1 | |
| DCA MLE+SEM, mpgen, with-comm (m5)Loss=MLE+SEM, Pointer=mpgen, Communication=with-comm, Agents=32018.03 | 46.2 | 30.01 | 40.65 | |
| MLE+RL, pgen, no-comm (m3)Loss=MLE+RL, Pointer=pgen, Communication=no-comm, Agents=12018.03 | 46.15 | 29.5 | 39.38 | |
| DCA MLE+SEM, pgen, no-comm (m4)Loss=MLE+SEM, Pointer=pgen, Communication=no-comm, Agents=32018.03 | 45.84 | 28.23 | 39.32 | |
| MLE+SEM, pgen, no-comm (m2)Loss=MLE+SEM, Pointer=pgen, Communication=no-comm, Agents=12018.03 | 44.5 | 28.04 | 38.8 | |
| MLE, pgen, no-comm (m1)Loss=MLE, Pointer=pgen, Communication=no-comm, Agents=12018.03 | 44.28 | 26.01 | 37.87 | |
| ML, no intra-attentionintra-attention=false, training=ML2018.03 | 44.26 | 27.43 | 40.41 |