Dialogue Summarization on SAMSum (test)
33ROUGE-2InstructDS
Evaluation results
| Method | Links | |||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| InstructDSReference summary length=true2023.10 | 33 | — | — | — | 58.6 | 54.5 | — | — | — | — | — | — | — | — | — | 58.7 | 59 | 33.1 | 33.2 | 54.6 | 54.8 | — | — | — | — | — | — | — | — | |
| InstructDSParams=3B, trainable parameters=37.7M (LoRA), reference summary length=true2023.10 | 32.8 | — | — | — | 58.4 | 48.9 | — | — | — | — | — | 58.5 | — | — | — | 58.5 | 58.8 | 32.9 | 33 | 49 | 49.2 | — | — | — | — | — | — | — | — | |
| InstructDSReference summary length=false2023.10 | 31.4 | — | — | — | 55.6 | 52.7 | — | — | — | — | — | — | — | — | — | 59.1 | 57.8 | 33.6 | 32.8 | 55.1 | 54.2 | — | — | — | — | — | — | — | — | |
| InstructDSParams=3B, trainable parameters=37.7M (LoRA), reference summary length=false2023.10 | 31.3 | — | — | — | 55.3 | 46.7 | — | — | — | — | — | 55.5 | — | — | — | 58.8 | 57.5 | 33.5 | 32.6 | 49.7 | 48.6 | — | — | — | — | — | — | — | — | |
| MoCaNumber of parameters=400M, Backbone=BART2022.12 | 30.57 | — | — | — | 55.13 | 50.88 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Z-Code++Number of parameters=710M2022.12 | 30.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Z-Code++Number of Parameters=800M2022.08 | 30.3 | — | — | — | 54.6 | 46.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SLiCNumber of parameters=2B2022.12 | 29.88 | — | — | — | 54.37 | 45.89 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT3Number of Parameters=175B2022.08 | 29.8 | — | — | — | 53.8 | 45.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GPT-3-finetuneParams=175B, trainable parameters=37.7M (LoRA), reference summary length=false2023.10 | 29.8 | — | — | — | 53.4 | 45.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UL2Number of Parameters=20B2022.08 | 29.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| JGR-RType=Ranker (re-rank outputs of JGR-G), Generator Backbone=BART-large, Ranker Backbone=RoBERTa-large2022.06 | 29.48 | — | — | — | 54.3 | 50.51 | 44.76 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ConDigSumReference summary length=false2023.10 | 29.4 | — | — | — | 54.4 | 51.3 | — | — | — | — | — | — | — | — | — | 56.2 | 57.8 | 30.5 | 31.4 | 52.3 | 53.7 | — | — | — | — | — | — | — | — | |
| ConDigSumParams=400M, reference summary length=false2023.10 | 29.3 | — | — | — | 54.3 | 45.2 | — | — | — | — | — | 54 | — | — | — | 56 | 57.6 | 30.4 | 31.2 | 46.6 | 48 | — | — | — | — | — | — | — | — | |
| CONDIGSUMBackbone=BART-Large, Parameters=400M2021.09 | 29.3 | — | — | — | 54.3 | 45.2 | — | — | — | — | — | 54 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| JGR-GType=Generator, Backbone=BART-large2022.06 | 29.22 | — | — | — | 53.85 | 49.93 | 44.33 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AVG2023.06 | 29.21 | — | — | — | 54.1 | 49.58 | — | — | — | — | — | 57.45 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.57 | |
| Semi-offline RL2023.06 | 29.19 | — | — | — | 54.27 | 50.57 | — | — | — | — | — | 57.62 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.63 | |
| BRIONumber of parameters=400M, Backbone=BART, Status=Self-implemented2022.12 | 29.06 | — | — | — | 53.74 | 49.37 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BART(DALL)Paradigm=Abstractive, Annotations=Keywords, Redundancy, and Topic (DALL)2021.05 | 28.79 | — | — | — | 53.7 | 50.81 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FreIns*Approach=Frequent Name with Insensitivity Training2023.05 | 28.73 | — | — | — | — | — | — | — | 17.25 | 7.66 | 3.14 | 75.53 | 6.39 | 3.43 | 1.38 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BART-LargeNumber of Parameters=400M2022.08 | 28.7 | — | — | — | 53.4 | 44.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BARTReference summary length=false2023.10 | 28.6 | — | — | — | 53.2 | 50.3 | — | — | — | — | — | — | — | — | — | 59.3 | 53.1 | 32.3 | 28.4 | 54.9 | 49.9 | — | — | — | — | — | — | — | — | |
| Coref-BARTReference summary length=false2023.10 | 28.6 | — | — | — | 53.9 | 50.4 | — | — | — | — | — | — | — | — | — | 57.1 | 56.6 | 30.7 | 29.8 | 52.5 | 52.3 | — | — | — | — | — | — | — | — | |
| Flan-T5-XXLReference summary length=false2023.10 | 28.6 | — | — | — | 52.8 | 50.2 | — | — | — | — | — | — | — | — | — | 62.8 | 50.2 | 34.2 | 27.3 | 57.8 | 47.7 | — | — | — | — | — | — | — | — | |
| CONDIGSUMBackbone=BART-Large, ablation=w/o Coherence2021.09 | 28.6 | — | — | — | 53.9 | 44.2 | — | — | — | — | — | 53.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FreApproach=Frequent Name Fine-tuning2023.05 | 28.55 | — | — | — | — | — | — | — | 25.17 | 11.31 | 4.5 | 74.24 | 9.77 | 5.3 | 2.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Coref-BARTParams=400M, reference summary length=false2023.10 | 28.5 | — | — | — | 53.7 | 44.3 | — | — | — | — | — | 53.5 | — | — | — | 56.9 | 56.4 | 30.5 | 29.7 | 46.9 | 46.5 | — | — | — | — | — | — | — | — | |
| Flan-T5-XXLParams=11B, reference summary length=false2023.10 | 28.5 | — | — | — | 52.6 | 44.1 | — | — | — | — | — | 53.2 | — | — | — | 62.6 | 50 | 34.1 | 27.1 | 52.5 | 41.9 | — | — | — | — | — | — | — | — | |
| MV-BARTReference summary length=false2023.10 | 28.5 | — | — | — | 54 | 50.6 | — | — | — | — | — | — | — | — | — | 55.8 | 57.5 | 29.5 | 30.7 | 51.5 | 53.2 | — | — | — | — | — | — | — | — | |
| BARTParams=400M, reference summary length=false2023.10 | 28.4 | — | — | — | 53 | 44.2 | — | — | — | — | — | 53.3 | — | — | — | 59 | 52.8 | 32.1 | 28.2 | 49.3 | 44 | — | — | — | — | — | — | — | — | |
| MV-BARTParams=400M, reference summary length=false2023.10 | 28.4 | — | — | — | 53.9 | 44.4 | — | — | — | — | — | 53.6 | — | — | — | 55.7 | 57.4 | 29.3 | 30.6 | 45.7 | 47.5 | — | — | — | — | — | — | — | — | |
| Multiview BART2021.09 | 28.4 | — | — | — | 53.9 | 44.4 | — | — | — | — | — | 53.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CONDIGSUMBackbone=BART-Large, ablation=w/o Sub-summary2021.09 | 28.3 | — | — | — | 53.8 | 44.1 | — | — | — | — | — | 53.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| HAT-CNNDMInitialization=hierarchical seq2seq model trained on CNN/DM2021.04 | 28.27 | — | — | — | 53.01 | 48.84 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BARTBackbone=BART-large, Implementation Source=Our Implementation2022.06 | 28.24 | — | — | — | 52.86 | 48.57 | 43.22 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Base2023.06 | 28.17 | — | — | — | 53.09 | 49.02 | — | — | — | — | — | 56.37 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.52 | |
| BARTNumber of parameters=400M, Backbone=BART, Status=Self-implemented2022.12 | 28.14 | — | — | — | 53.42 | 49.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FinetunedNumber of parameters=400M, Backbone=BART, Protocol=supervised fine-tuning2022.12 | 28.14 | — | — | — | 53.42 | 49.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Flan-UL2Reference summary length=false2023.10 | 28.1 | — | — | — | 53.4 | 50.2 | — | — | — | — | — | — | — | — | — | 60.4 | 52.6 | 32.2 | 27.8 | 55.5 | 49.1 | — | — | — | — | — | — | — | — | |
| BART(DKE)Paradigm=Abstractive, Annotations=Keywords (DKE)2021.05 | 28.03 | — | — | — | 53.43 | 49.93 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Transformer-CNNDMInitialization=BART CNN/DM model2021.04 | 28.03 | — | — | — | 53 | 48.59 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BART(DRD)Paradigm=Abstractive, Annotations=Redundancy (DRD)2021.05 | 28.01 | — | — | — | 53.39 | 49.49 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Flan-UL2Params=20B, reference summary length=false2023.10 | 28 | — | — | — | 53.3 | 44.1 | — | — | — | — | — | 53.5 | — | — | — | 60.3 | 52.5 | 32 | 27.7 | 50 | 43.3 | — | — | — | — | — | — | — | — | |
| MV-BARTParadigm=Abstractive2021.05 | 27.98 | — | — | — | 53.42 | 49.97 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FreAugApproach=Frequent Name Data Augmentation2023.05 | 27.86 | — | — | — | — | — | — | — | 25.03 | 11.09 | 4.39 | 75.02 | 9.58 | 5.12 | 2.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BART(DTS)Paradigm=Abstractive, Annotations=Topic (DTS)2021.05 | 27.85 | — | — | — | 53.34 | 49.64 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ProphetNet2022.06 | 27.77 | — | — | — | 52.62 | 48.33 | 42.91 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BARTParadigm=Abstractive, Dataset=Original SAMSum2021.05 | 27.67 | — | — | — | 52.98 | 49.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PEGASUS2022.06 | 27.59 | — | — | — | 51.99 | 47.56 | 42.38 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BART_ORIBackbone=BART-Large2021.09 | 27.2 | — | — | — | 52.6 | 42.7 | — | — | — | — | — | 52.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| T5-LargeNumber of Parameters=800M2022.08 | 27 | — | — | — | 51 | 46.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BARTBackbone=BART-Large, Parameters=400M2021.09 | 27 | — | — | — | 52.6 | 42.1 | — | — | — | — | — | 52.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| IDApproach=In-distribution Baseline2023.05 | 26.97 | — | — | — | — | — | — | — | — | — | — | 74.26 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PEGASUS-LargeNumber of Parameters=500M2022.08 | 26.3 | — | — | — | 50.2 | 46.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Flan-T5-LargeReference summary length=false2023.10 | 25.9 | — | — | — | 51.3 | 48.7 | — | — | — | — | — | — | — | — | — | 58.7 | 50.1 | 29.7 | 25.4 | 54.2 | 47.3 | — | — | — | — | — | — | — | — | |
| CONDIGSUM_BASEBackbone=BART-Base, Parameters=140M2021.09 | 24 | — | — | — | 48.1 | 39.2 | — | — | — | — | — | 48 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BART_BASEBackbone=BART-Base, Parameters=140M2021.09 | 22.3 | — | — | — | 46.1 | 36.4 | — | — | — | — | — | 44.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DynamicConv + News2021.09 | 20.7 | — | — | — | 45.4 | 41.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DynamicConv + GPT22021.04 | 20.65 | — | — | — | 45.41 | 41.45 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TGDGAParadigm=Abstractive2021.05 | 19.15 | — | — | — | 43.11 | 40.49 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FastAbs-RL2021.09 | 18.1 | — | — | — | 42 | 39.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| D-HGNParadigm=Abstractive2021.05 | 18.07 | — | — | — | 42.03 | 39.56 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DialoGPTParadigm=Abstractive, Note=Fine-tuned on SAMSum2021.05 | 16.58 | — | — | — | 39.77 | 38.42 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DynamicConv + GPT-22021.09 | 16.4 | — | — | — | 41.8 | 37.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DIONYSUSModel Size=Large, Evaluation Protocol=Zero-shot, Strategy=Better ROUGE2022.12 | 16.2 | — | — | — | 41.3 | 30.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DIONYSUSModel Size=Large, Evaluation Protocol=Zero-shot, Strategy=All G2022.12 | 16.1 | — | — | — | 41.3 | 30.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Pointer-Generatorreference summary length=false2023.10 | 15.3 | — | — | — | 40.1 | 36.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PTGen2021.09 | 15.3 | — | — | — | 40.1 | 36.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ChatGPTReference summary length=true2023.10 | 13.8 | — | — | — | 40.9 | 37.7 | — | — | — | — | — | — | — | — | — | 39.5 | 43.5 | 13.2 | 14.7 | 36.6 | 39.5 | — | — | — | — | — | — | — | — | |
| ChatGPTParams=175B, reference summary length=true2023.10 | 13.7 | — | — | — | 40.8 | 31.5 | — | — | — | — | — | 40 | — | — | — | 39.3 | 43.4 | 13.2 | 14.6 | 30.5 | 33.4 | — | — | — | — | — | — | — | — | |
| ChatGPTReference summary length=false2023.10 | 12.4 | — | — | — | 32.9 | 31.6 | — | — | — | — | — | — | — | — | — | 22.5 | 70.6 | 8.5 | 27.3 | 22.4 | 59.3 | — | — | — | — | — | — | — | — | |
| ChatGPTParams=175B, reference summary length=false2023.10 | 12.3 | — | — | — | 32.7 | 24.7 | — | — | — | — | — | 32.5 | — | — | — | 22.4 | 70.2 | 8.4 | 27.1 | 16.9 | 53.6 | — | — | — | — | — | — | — | — | |
| TransformerParadigm=Abstractive2021.05 | 11.18 | — | — | — | 36.62 | 33.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LONGEST-3Paradigm=Extractive2021.05 | 10.27 | — | — | — | 32.46 | 29.92 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Lead32021.09 | 8.7 | — | — | — | 31.4 | 29.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TextRankParadigm=Extractive2021.05 | 8.02 | — | — | — | 29.27 | 28.78 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PEGASUSModel Size=Large, Evaluation Protocol=Zero-shot2022.12 | 7.6 | — | — | — | 27.5 | 21.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DIONYSUSModel Size=Large, Evaluation Protocol=Zero-shot, Strategy=All P2022.12 | 7.5 | — | — | — | 23.5 | 18.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AlpacaParams=7B, reference summary length=false2023.10 | 5.7 | — | — | — | 28.2 | 20.5 | — | — | — | — | — | 19.4 | — | — | — | 26 | 39.8 | 5.1 | 8.3 | 19.2 | 29 | — | — | — | — | — | — | — | — | |
| AlpacaReference summary length=false2023.10 | 5.7 | — | — | — | 28.3 | 26.5 | — | — | — | — | — | — | — | — | — | 26.1 | 40 | 5.2 | 8.4 | 24.6 | 34.9 | — | — | — | — | — | — | — | — | |
| GSG+Evaluation Protocol=Zero-shot2022.12 | 3.5 | — | — | — | 13.3 | 12 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| T5v1.1Model Size=Large, Evaluation Protocol=Zero-shot2022.12 | 1.6 | — | — | — | 9.6 | 8.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BARTkeywords=none2021.05 | — | 3.66 | 3.65 | 3.66 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BARTkeywords=D_KE2021.05 | — | 3.88 | 3.77 | 3.79 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BARTkeywords=D_RD2021.05 | — | 3.74 | 3.98 | 3.89 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BARTkeywords=D_TS2021.05 | — | 3.95 | 3.76 | 4.01 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BARTkeywords=D_ALL2021.05 | — | 4.05 | 3.78 | 4.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BARTSize=Large2021.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.14 | 0.12 | 0.31 | 0.43 | 3.03 | — | |
| CONDIGSUM2021.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.26 | 0.32 | 0.23 | 0.19 | 2.35 | — | |
| DIONYSUS_LARGEzero-shot=true, model_size=Large2022.12 | — | — | — | — | — | — | — | 4.04 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DP-ICLAdaptation=DP-ICL, LLM Type=Closed, Model=GPT3 Davinci, Reveals=DT+Q2024.11 | — | — | — | — | — | 31.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0 | 665.91 | — | — | — | — | — | — | |
| Gold2021.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.41 | 0.29 | 0.21 | 0.09 | 1.98 | — | |
| Golden2021.05 | — | 4.37 | 4.26 | 4.27 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Human-writtenmode=Reference2022.12 | — | — | — | — | — | — | — | 4.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Multiview BART2021.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.19 | 0.27 | 0.25 | 0.29 | 2.64 | — | |
| MV-BART2021.05 | — | 3.85 | 3.76 | 3.88 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PEGASUS_LARGEzero-shot=true, model_size=Large2022.12 | — | — | — | — | — | — | — | 3.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PrivateLoRAAdaptation=PrivateLoRA, LLM Type=Open, Model=BART-Large, Reveals=None2024.11 | — | — | — | — | — | 39.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 3.63 | 0.8 | — | — | — | — | — | — | |
| T5v1.1_LARGEzero-shot=true, model_size=Large2022.12 | — | — | — | — | — | — | — | 3.54 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |