Lead Paragraph Generation on WikiSum CommonCrawl static (test)
38.8ROUGE-LLM + D MCA + MoE 256
Evaluation Results
| Method | Links | |
|---|---|---|
| LM + D MCA + MoE 256InputLen=7.5K, Data Source=Unrestricted web search2019.10 | 38.8 | |
| Multi-task Graph + Top-100 Attention + E-MCAInputLen=11K, Data Source=CommonCrawl2019.10 | 36.5 | |
| LM + D-MCAInputLen=11K, Data Source=Unrestricted web search2019.10 | 36.2 | |
| Multi-task Graph + Top-100 AttentionInputLen=500, Data Source=CommonCrawl2019.10 | 35.2 | |
| Multi-task GraphInputLen=500, Data Source=CommonCrawl2019.10 | 34.9 | |
| Multi-taskInputLen=500, Data Source=CommonCrawl2019.10 | 34.4 | |
| T + D to PInputLen=500, Data Source=Unrestricted web search2019.10 | 34.2 | |
| T + D to PInputLen=500, Data Source=CommonCrawl2019.10 | 33.8 |