Summarization on BigPatent (test)
62.9ROUGE-1BART_joint
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BART_jointMemory=Self2023.05 | 62.9 | 48.1 | 59.6 | |
| BART_dual*Memory=Self2023.05 | 61.2 | 44.6 | 52.3 | |
| REINA (L)Memory=Retrieval2023.05 | 60.7 | 43.3 | 51.3 | |
| BART_jointMemory=Retrieval2023.05 | 59.6 | 43.4 | 51 | |
| REINA (B)Memory=Retrieval2023.05 | 59.5 | 42.6 | 50.6 | |
| BART_dual*Memory=Retrieval2023.05 | 57.4 | 43.3 | 49.7 | |
| MSEA2024.11 | 54.1 | 35.2 | 44.7 | |
| PEGASUSMemory=None2023.05 | 53.6 | 33.2 | 43.2 | |
| IMHAMYear=20232024.11 | 53.5 | 34.7 | 44.2 | |
| STNLTPYear=20222024.11 | 52.8 | 34.4 | 43.1 | |
| RLCPRAYear=20212024.11 | 52.1 | 34.2 | 42.4 | |
| MedWriterYear=20202024.11 | 51.8 | 33.9 | 41.9 | |
| TransformerYear=20172024.11 | 49.1 | 31.6 | 40.2 | |
| SuRuNNerYear=20172024.11 | 48.2 | 29.3 | 39.3 | |
| REINA (PG)Memory=Retrieval2023.05 | 44.6 | 21.5 | 33.3 | |
| BARTMemory=None2023.05 | 44.4 | 21.3 | 31 | |
| TextRank2024.11 | 43.2 | 23.5 | 36.7 |