# Summarization on XSum (test)

Source: [Summarization on XSum (test)](<https://www.sota2.com/research/sota/summarization-on-xsum-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-29T08:34:38.610Z

Evaluation of abstractive text summarization performance on the test split of the XSum dataset, typically measured using ROUGE metrics (R-1, R-2, R-L).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Summarization |
| Dataset (including any stated split) | XSum (test) |
| Metric | ROUGE-2 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 328 of 328 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [ROUGE-2](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=ROUGE-2>): Higher is better; unit: PERCENT.

- [ROUGE-1](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=ROUGE-1>): Higher is better; unit: PERCENT.

- [ROUGE-L](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=ROUGE-L>): Higher is better; unit: PERCENT.

- [Beam Size](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Beam%20Size>): Higher is better; unit: SCALAR.

- [Model Setting](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Model%20Setting>): Higher is better; unit: SCALAR.

- [Human Overall Score](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Human%20Overall%20Score>): Higher is better; unit: PERCENT.

- [Human Conciseness](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Human%20Conciseness>): Higher is better; unit: PERCENT.

- [Human Fluency](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Human%20Fluency>): Higher is better; unit: PERCENT.

- [Human No-Hallucination](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Human%20No-Hallucination>): Higher is better; unit: PERCENT.

- [Human Informativeness](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Human%20Informativeness>): Higher is better; unit: PERCENT.

- [ROUGE-LSum](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=ROUGE-LSum>): Higher is better; unit: PERCENT.

- [BLEU](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=BLEU>): Higher is better; unit: PERCENT.

- [BLEURT](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=BLEURT>): Higher is better; unit: PERCENT.

- [BERTScore](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=BERTScore>): Higher is better; unit: PERCENT.

- [Perplexity (PPL)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Perplexity%20(PPL)>): Lower is better; unit: SCALAR.

- [Distinct N-grams (DIST)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Distinct%20N-grams%20(DIST)>): Higher is better; unit: SCALAR.

- [Entropy (ENT)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Entropy%20(ENT)>): Higher is better; unit: SCALAR.

- [Compression Score (S-BL)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Compression%20Score%20(S-BL)>): Higher is better; unit: SCALAR.

- [Repetition Score (Rep-4)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Repetition%20Score%20(Rep-4)>): Lower is better; unit: PERCENT.

- [Compression Ratio (BL)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Compression%20Ratio%20(BL)>): Higher is better; unit: SCALAR.

- [Overall Score (0-1)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Overall%20Score%20(0-1)>): Higher is better; unit: SCALAR.

- [Average Length (Len)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Average%20Length%20(Len)>): Higher is better; unit: SCALAR.

- [AuBL Score](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=AuBL%20Score>): Higher is better; unit: SCALAR.

- [Human Score (HM)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Human%20Score%20(HM)>): Higher is better; unit: PERCENT.

- [Speedup](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Speedup>): Higher is better; unit: SCALAR.

- [Truth Accuracy](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Truth%20Accuracy>): Higher is better; unit: PERCENT.

- [FActScore](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=FActScore>): Higher is better; unit: SCALAR.

- [Accept Rate](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Accept%20Rate>): Higher is better; unit: PERCENT.

- [Beam Score (BS)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Beam%20Score%20(BS)>): Higher is better; unit: PERCENT.

- [Model Score (MS)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Model%20Score%20(MS)>): Higher is better; unit: PERCENT.

- [Exact Match (EM)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Exact%20Match%20(EM)>): Higher is better; unit: PERCENT.

- [Compression Metric (CM)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Compression%20Metric%20(CM)>): Lower is better; unit: SCALAR.

- [Semantic Metric (SM)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Semantic%20Metric%20(SM)>): Higher is better; unit: SCALAR.

- [Uniqueness/Entropy (UE)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Uniqueness%2FEntropy%20(UE)>): Higher is better; unit: PERCENT.

- [Faithfulness (Fe)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Faithfulness%20(Fe)>): Higher is better; unit: PERCENT.

- [Factual Information Score (Fi)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Factual%20Information%20Score%20(Fi)>): Higher is better; unit: PERCENT.

- [Semantic Coherence (SC)](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=Semantic%20Coherence%20(SC)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | ROUGE-2 | Result date | Report paper |
| --- | --- | --- | --- |
| ORACLE | 60.61 | Not recorded | 68fa6a011e209131cea254db |
| ORACLE | 42.22 | Not recorded | 68fa6a011e209131cea254db |
| Oracle | 32.27 | Not recorded | 6a191dafdbd7150506f8294f |
| Oracle | 31.35 | Not recorded | 6a191dafdbd7150506f8294f |
| Max (Oracle Selection) | 28.28 | Not recorded | 68fa6a0c1e209131cea25bc2 |
| ST-MoE | 27.1 | Not recorded | 68fa6e2c1e209131cea3e504 |
| Zoph et al. | 27.1 | Not recorded | 68fa6eaf1e209131cea416bb |
| ST-MoE | 27.1 | Not recorded | 68fa6fa51e209131cea46dfe |
| SLiC | 27.09 | Not recorded | 68fa6e2c1e209131cea3e504 |
| BRIO\_joint | 26.7 | Not recorded | 68fa71aa1e209131cea526bf |
| UL20B | 26.6 | Not recorded | 68fa6eaf1e209131cea416bb |
| UL2 | 26.6 | Not recorded | 68fa6fa51e209131cea46dfe |
| BRIO\_joint | 26.5 | Not recorded | 68fa71aa1e209131cea526bf |
| BRIO\_dual\* | 26.2 | Not recorded | 68fa71aa1e209131cea526bf |
| BRIO\_dual\* | 26.1 | Not recorded | 68fa71aa1e209131cea526bf |
| REINA (PG) | 26 | Not recorded | 68fa71aa1e209131cea526bf |
| MoCa | 25.91 | Not recorded | 68fa6e2c1e209131cea3e504 |
| BRIO | 25.6 | Not recorded | 68fa71aa1e209131cea526bf |
| BRIO-Mul | 25.59 | Not recorded | 68fa6c2f1e209131cea32a8b |
| BRIO | 25.59 | Not recorded | 68fa6e2c1e209131cea3e504 |
| BRIO-Ctr | 25.13 | Not recorded | 68fa6c2f1e209131cea32a8b |
| Our Model | 25.08 | Not recorded | 68fa6ad91e209131cea2ac58 |
| FROST | 25.06 | Not recorded | 68fa6c161e209131cea320bd |
| FROST | 25.06 | Not recorded | 68fa6c161e209131cea320bd |
| PEGASUS | 24.87 | Not recorded | 68fa6c161e209131cea320bd |
| PEGASUS | 24.87 | Not recorded | 68fa6c161e209131cea320bd |
| Pegasus (Reported) | 24.83 | Not recorded | 68fa690b1e209131cea1faf6 |
| PEGASUS | 24.83 | Not recorded | 68fa6ac91e209131cea2a36c |
| Z-Code++ | 24.7 | Not recorded | 68fa6fa51e209131cea46dfe |
| PEGASUS | 24.69 | Not recorded | 68fa6c2f1e209131cea32a8b |
| ConSum | 24.67 | Not recorded | 68fa6c2f1e209131cea32a8b |
| Z-Code++ | 24.6 | Not recorded | 68fa6e2c1e209131cea3e504 |
| PEGASUS-Large | 24.6 | Not recorded | 68fa6fa51e209131cea46dfe |
| PEGASUS\_LARGE | 24.6 | Not recorded | 68fa6fa51e209131cea46dfe |
| Z-Code++\_LARGE | 24.6 | Not recorded | 68fa6fa51e209131cea46dfe |
| PEGASUS | 24.6 | Not recorded | 68fa71aa1e209131cea526bf |
| SimCLS | 24.57 | Not recorded | 68fa6a0c1e209131cea25bc2 |
| SimCLS | 24.57 | Not recorded | 68fa6c2f1e209131cea32a8b |
| PEGASUSLARGE | 24.56 | Not recorded | 68fa67f91e209131cea198c5 |
| PEGASUS | 24.56 | Not recorded | 68fa6a011e209131cea254db |
| Pegasus | 24.56 | Not recorded | 68fa6a0c1e209131cea25bc2 |
| PEGASUS | 24.56 | Not recorded | 68fa6c2f1e209131cea32a8b |
| PEGASUS fine-tuned | 24.56 | Not recorded | 68fa6c8b1e209131cea34a28 |
| PEGASUS | 24.56 | Not recorded | 68fa6dbd1e209131cea3bb89 |
| PEGASUS | 24.56 | Not recorded | 68fa6e2c1e209131cea3e504 |
| PEGASUS | 24.56 | Not recorded | 68fa6ad91e209131cea2ac58 |
| Origin (Pegasus baseline) | 24.53 | Not recorded | 68fa6a0c1e209131cea25bc2 |
| Finetuned | 24.53 | Not recorded | 68fa6e2c1e209131cea3e504 |
| Pegasus (Re-eval) | 24.31 | Not recorded | 68fa690b1e209131cea1faf6 |
| REINA (L) | 24.1 | Not recorded | 68fa71aa1e209131cea526bf |
| BIGBIRD-Pegasus | 24.05 | Not recorded | 68fa690b1e209131cea1faf6 |
| BigBird | 24.05 | Not recorded | 68fa6ac91e209131cea2a36c |
| Random (Oracle Selection) | 23.64 | Not recorded | 68fa6a0c1e209131cea25bc2 |
| GLM | 23.5 | Not recorded | 68fa6c111e209131cea31e21 |
| HAT-BART | 22.79 | Not recorded | 68fa6ac91e209131cea2a36c |
| PEGFAME | 22.75 | Not recorded | 68fa6a011e209131cea254db |
| FAME | 22.75 | Not recorded | 68fa6c161e209131cea320bd |
| FAME | 22.75 | Not recorded | 68fa6c161e209131cea320bd |
| BART + TA | 22.68 | Not recorded | 68fa6ad91e209131cea2ac58 |
| GOLD-s | 22.58 | Not recorded | 68fa6c2f1e209131cea32a8b |
| SeqCo | 22.41 | Not recorded | 68fa6c2f1e209131cea32a8b |
| BART | 22.3 | Not recorded | 68fa6c111e209131cea31e21 |
| BART-Large | 22.3 | Not recorded | 68fa6fa51e209131cea46dfe |
| BART | 22.27 | Not recorded | 68fa66921e209131cea10fff |
| BART\_LARGE | 22.27 | Not recorded | 68fa67211e209131cea14832 |
| Previous SOTA | 22.27 | Not recorded | 68fa67f91e209131cea198c5 |
| BART | 22.27 | Not recorded | 68fa690b1e209131cea1faf6 |
| FINE-TUNE | 22.27 | Not recorded | 68fa690f1e209131cea1fe0e |
| BART | 22.27 | Not recorded | 68fa6a011e209131cea254db |
| BART | 22.27 | Not recorded | 68fa6a0c1e209131cea25bc2 |
| BART | 22.27 | Not recorded | 68fa6c161e209131cea320bd |
| BART | 22.27 | Not recorded | 68fa6c2f1e209131cea32a8b |
| BARTLARGE fine-tuned | 22.27 | Not recorded | 68fa6c8b1e209131cea34a28 |
| BART | 22.27 | Not recorded | 68fa6dbd1e209131cea3bb89 |
| BART | 22.27 | Not recorded | 68fa6e2c1e209131cea3e504 |
| BART | 22.27 | Not recorded | 68fa6ac91e209131cea2a36c |
| BART | 22.27 | Not recorded | 68fa6ad91e209131cea2ac58 |
| PEGASUS | 22.26 | Not recorded | 68fa6a011e209131cea254db |
| GOLD-p | 22.26 | Not recorded | 68fa6c2f1e209131cea32a8b |
| Composition (FROST) | 22.24 | Not recorded | 68fa6c161e209131cea320bd |

### ORACLE

ROUGE-2: 60.61. Result ID: 698dfc82ffc3901de099f562.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a011e209131cea254db.md>)

Recorded evaluation configuration: {"Context":"PEGFAME baseline"}. This record does not assert independent reproduction.

### ORACLE

ROUGE-2: 42.22. Result ID: 698dfc82ffc3901de099f55e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a011e209131cea254db.md>)

Recorded evaluation configuration: {"Context":"ROBFAME baseline"}. This record does not assert independent reproduction.

### Oracle

ROUGE-2: 32.27. Result ID: 6a194f8efbc373592c13b047.

[Reporting paper](<https://www.sota2.com/research/paper/6a191dafdbd7150506f8294f.md>)

Recorded evaluation configuration: {"Setting":"beam-sim"}. This record does not assert independent reproduction.

### Oracle

ROUGE-2: 31.35. Result ID: 6a194f8efbc373592c13b040.

[Reporting paper](<https://www.sota2.com/research/paper/6a191dafdbd7150506f8294f.md>)

Recorded evaluation configuration: {"Setting":"epsilon"}. This record does not assert independent reproduction.

### Max (Oracle Selection)

ROUGE-2: 28.28. Result ID: 698e0496ffc3901de09a2d82.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a0c1e209131cea25bc2.md>)

Recorded evaluation configuration: {"Strategy":"Candidate selection based on highest ROUGE"}. This record does not assert independent reproduction.

### ST-MoE

ROUGE-2: 27.1. Result ID: 6990133b3a6c314849fdf224.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e2c1e209131cea3e504.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c641e209131cea33c61.md>)

[Implementation](<https://github.com/tensorflow/mesh/blob/master/mesh_tensorflow/transformer/moe.py>)

Recorded evaluation configuration: {"Number of parameters":"268B"}. This record does not assert independent reproduction.

### Zoph et al.

ROUGE-2: 27.1. Result ID: 69903a933a6c314849ff1114.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6eaf1e209131cea416bb.md>)

Recorded evaluation configuration: {"status":"previous state-of-the-art"}. This record does not assert independent reproduction.

### ST-MoE

ROUGE-2: 27.1. Result ID: 6990f9643a6c31484904baf6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fa51e209131cea46dfe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c641e209131cea33c61.md>)

[Implementation](<https://github.com/tensorflow/mesh/blob/master/mesh_tensorflow/transformer/moe.py>)

Recorded evaluation configuration: {"Number of Parameters":"268B"}. This record does not assert independent reproduction.

### SLiC

ROUGE-2: 27.09. Result ID: 6990133b3a6c314849fdf226.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e2c1e209131cea3e504.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d8f1e209131cea3a999.md>)

Recorded evaluation configuration: {"Number of parameters":"2B"}. This record does not assert independent reproduction.

### BRIO\_joint

ROUGE-2: 26.7. Result ID: 6991da1c3a6c3148490afdb6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71aa1e209131cea526bf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71aa1e209131cea526bf.md>)

[Implementation](<https://github.com/Hannibal046/SelfMemory>)

Recorded evaluation configuration: {"Memory":"Self"}. This record does not assert independent reproduction.

### UL20B

ROUGE-2: 26.6. Result ID: 69903a933a6c314849ff1115.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6eaf1e209131cea416bb.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eaf1e209131cea416bb.md>)

[Implementation](<https://github.com/google-research/google-research/tree/master/ul2>)

Recorded evaluation configuration: {"mode":"supervised finetuning"}. This record does not assert independent reproduction.

### UL2

ROUGE-2: 26.6. Result ID: 6990f9643a6c31484904ba8e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fa51e209131cea46dfe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eaf1e209131cea416bb.md>)

[Implementation](<https://github.com/google-research/google-research/tree/master/ul2>)

Recorded evaluation configuration: {"Number of Parameters":"20B"}. This record does not assert independent reproduction.

### BRIO\_joint

ROUGE-2: 26.5. Result ID: 6991da1c3a6c3148490afdb4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71aa1e209131cea526bf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71aa1e209131cea526bf.md>)

[Implementation](<https://github.com/Hannibal046/SelfMemory>)

Recorded evaluation configuration: {"Memory":"Retrieval"}. This record does not assert independent reproduction.

### BRIO\_dual\*

ROUGE-2: 26.2. Result ID: 6991da1c3a6c3148490afdb5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71aa1e209131cea526bf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71aa1e209131cea526bf.md>)

[Implementation](<https://github.com/Hannibal046/SelfMemory>)

Recorded evaluation configuration: {"Memory":"Self"}. This record does not assert independent reproduction.

### BRIO\_dual\*

ROUGE-2: 26.1. Result ID: 6991da1c3a6c3148490afdb3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71aa1e209131cea526bf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71aa1e209131cea526bf.md>)

[Implementation](<https://github.com/Hannibal046/SelfMemory>)

Recorded evaluation configuration: {"Memory":"Retrieval"}. This record does not assert independent reproduction.

### REINA (PG)

ROUGE-2: 26. Result ID: 6991da1c3a6c3148490afdb0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71aa1e209131cea526bf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bfc1e209131cea31717.md>)

Recorded evaluation configuration: {"Memory":"Retrieval"}. This record does not assert independent reproduction.

### MoCa

ROUGE-2: 25.91. Result ID: 6990133b3a6c314849fdf228.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e2c1e209131cea3e504.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e2c1e209131cea3e504.md>)

Recorded evaluation configuration: {"Number of parameters":"568M","Backbone":"PEGASUS"}. This record does not assert independent reproduction.

### BRIO

ROUGE-2: 25.6. Result ID: 6991da1c3a6c3148490afdaf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71aa1e209131cea526bf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c2f1e209131cea32a8b.md>)

[Implementation](<https://github.com/yixinL7/BRIO>)

Recorded evaluation configuration: {"Memory":"None"}. This record does not assert independent reproduction.

### BRIO-Mul

ROUGE-2: 25.59. Result ID: 698eee2f3a6c314849f3a0a2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c2f1e209131cea32a8b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c2f1e209131cea32a8b.md>)

[Implementation](<https://github.com/yixinL7/BRIO>)

Recorded evaluation configuration: {"Backbone":"PEGASUS","Training Loss":"Multi-task Loss","Training Mode":"Fine-tuned"}. This record does not assert independent reproduction.

### BRIO

ROUGE-2: 25.59. Result ID: 6990133b3a6c314849fdf225.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e2c1e209131cea3e504.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c2f1e209131cea32a8b.md>)

[Implementation](<https://github.com/yixinL7/BRIO>)

Recorded evaluation configuration: {"Number of parameters":"568M","Backbone":"PEGASUS"}. This record does not assert independent reproduction.

### BRIO-Ctr

ROUGE-2: 25.13. Result ID: 698eee2f3a6c314849f3a0a1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c2f1e209131cea32a8b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c2f1e209131cea32a8b.md>)

[Implementation](<https://github.com/yixinL7/BRIO>)

Recorded evaluation configuration: {"Backbone":"PEGASUS","Training Loss":"Contrastive Loss Only","Training Mode":"Fine-tuned"}. This record does not assert independent reproduction.

### Our Model

ROUGE-2: 25.08. Result ID: 6a042ac947f34ce924e9c1c4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ad91e209131cea2ac58.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ad91e209131cea2ac58.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### FROST

ROUGE-2: 25.06. Result ID: 698ecce0ffc3901de0a159a4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c161e209131cea320bd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c161e209131cea320bd.md>)

[Implementation](<https://github.com/google-research/language/tree/master/language/frost>)

Recorded evaluation configuration: {"Decoding":"Single"}. This record does not assert independent reproduction.

### FROST

ROUGE-2: 25.06. Result ID: 698ecce0ffc3901de0a159d1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c161e209131cea320bd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c161e209131cea320bd.md>)

[Implementation](<https://github.com/google-research/language/tree/master/language/frost>)

Recorded evaluation configuration: {"decoding\_type":"Single"}. This record does not assert independent reproduction.

### PEGASUS

ROUGE-2: 24.87. Result ID: 698ecce0ffc3901de0a159a3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c161e209131cea320bd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: {"Decoding":"Single"}. This record does not assert independent reproduction.

### PEGASUS

ROUGE-2: 24.87. Result ID: 698ecce0ffc3901de0a159d0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c161e209131cea320bd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: {"decoding\_type":"Single"}. This record does not assert independent reproduction.

### Pegasus (Reported)

ROUGE-2: 24.83. Result ID: 698d945f8b517eb4332277b5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa690b1e209131cea1faf6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: {"Model Size":"Large"}. This record does not assert independent reproduction.

### PEGASUS

ROUGE-2: 24.83. Result ID: 699ad1035698665ec45ffba9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ac91e209131cea2a36c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Z-Code++

ROUGE-2: 24.7. Result ID: 6990f9643a6c31484904ba8f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fa51e209131cea46dfe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fa51e209131cea46dfe.md>)

Recorded evaluation configuration: {"Number of Parameters":"800M"}. This record does not assert independent reproduction.

### PEGASUS

ROUGE-2: 24.69. Result ID: 698eee2f3a6c314849f3a0a0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c2f1e209131cea32a8b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: {"Backbone":"PEGASUS","Evaluation Source":"Current Paper Evaluation Script"}. This record does not assert independent reproduction.

### ConSum

ROUGE-2: 24.67. Result ID: 698eee2f3a6c314849f3a09b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c2f1e209131cea32a8b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a961e209131cea2920c.md>)

Recorded evaluation configuration: {"Backbone":"BART","Evaluation Source":"Original Paper"}. This record does not assert independent reproduction.

### Z-Code++

ROUGE-2: 24.6. Result ID: 6990133b3a6c314849fdf223.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e2c1e209131cea3e504.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fa51e209131cea46dfe.md>)

Recorded evaluation configuration: {"Number of parameters":"710M"}. This record does not assert independent reproduction.

### PEGASUS-Large

ROUGE-2: 24.6. Result ID: 6990f9643a6c31484904ba8b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fa51e209131cea46dfe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: {"Number of Parameters":"500M"}. This record does not assert independent reproduction.

### PEGASUS\_LARGE

ROUGE-2: 24.6. Result ID: 6990f9643a6c31484904baf7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fa51e209131cea46dfe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: {"Number of Parameters":"470M"}. This record does not assert independent reproduction.

### Z-Code++\_LARGE

ROUGE-2: 24.6. Result ID: 6990f9643a6c31484904baf8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fa51e209131cea46dfe.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fa51e209131cea46dfe.md>)

Recorded evaluation configuration: {"Number of Parameters":"710M"}. This record does not assert independent reproduction.

### PEGASUS

ROUGE-2: 24.6. Result ID: 6991da1c3a6c3148490afdae.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71aa1e209131cea526bf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: {"Memory":"None"}. This record does not assert independent reproduction.

### SimCLS

ROUGE-2: 24.57. Result ID: 698e0496ffc3901de09a2d84.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a0c1e209131cea25bc2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a0c1e209131cea25bc2.md>)

[Implementation](<https://github.com/yixinL7/SimCLS>)

Recorded evaluation configuration: {"Base Model":"Pegasus"}. This record does not assert independent reproduction.

### SimCLS

ROUGE-2: 24.57. Result ID: 698eee2f3a6c314849f3a09f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c2f1e209131cea32a8b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a0c1e209131cea25bc2.md>)

[Implementation](<https://github.com/yixinL7/SimCLS>)

Recorded evaluation configuration: {"Backbone":"BART","Evaluation Model":"RoBERTa","Evaluation Source":"Original Paper"}. This record does not assert independent reproduction.

### PEGASUSLARGE

ROUGE-2: 24.56. Result ID: 698d534a8b517eb43320a766.

[Reporting paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: {"Model Size":"Large","Pre-training Corpus":"HugeNews"}. This record does not assert independent reproduction.

### PEGASUS

ROUGE-2: 24.56. Result ID: 698dfc82ffc3901de099f55a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a011e209131cea254db.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: {"Source":"Zhang et al., 2019"}. This record does not assert independent reproduction.

### Pegasus

ROUGE-2: 24.56. Result ID: 698e0496ffc3901de09a2d7e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a0c1e209131cea25bc2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PEGASUS

ROUGE-2: 24.56. Result ID: 698eee2f3a6c314849f3a099.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c2f1e209131cea32a8b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: {"Evaluation Source":"Original Paper"}. This record does not assert independent reproduction.

### PEGASUS fine-tuned

ROUGE-2: 24.56. Result ID: 698f226c3a6c314849f61274.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c8b1e209131cea34a28.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: {"φ%":"100"}. This record does not assert independent reproduction.

### PEGASUS

ROUGE-2: 24.56. Result ID: 698fd62c3a6c314849fc37e4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6dbd1e209131cea3bb89.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: {"Evaluation Protocol":"Fully-supervised"}. This record does not assert independent reproduction.

### PEGASUS

ROUGE-2: 24.56. Result ID: 6990133b3a6c314849fdf221.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e2c1e209131cea3e504.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: {"Number of parameters":"568M","Backbone":"PEGASUS"}. This record does not assert independent reproduction.

### PEGASUS

ROUGE-2: 24.56. Result ID: 6a042ac947f34ce924e9c1c1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ad91e209131cea2ac58.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Origin (Pegasus baseline)

ROUGE-2: 24.53. Result ID: 698e0496ffc3901de09a2d80.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a0c1e209131cea25bc2.md>)

Recorded evaluation configuration: {"Base Model":"Pegasus"}. This record does not assert independent reproduction.

### Finetuned

ROUGE-2: 24.53. Result ID: 6990133b3a6c314849fdf227.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e2c1e209131cea3e504.md>)

Recorded evaluation configuration: {"Number of parameters":"568M","Backbone":"PEGASUS","Protocol":"supervised fine-tuning"}. This record does not assert independent reproduction.

### Pegasus (Re-eval)

ROUGE-2: 24.31. Result ID: 698d945f8b517eb4332277b6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa690b1e209131cea1faf6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: {"Model Size":"Large"}. This record does not assert independent reproduction.

### REINA (L)

ROUGE-2: 24.1. Result ID: 6991da1c3a6c3148490afdb2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa71aa1e209131cea526bf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bfc1e209131cea31717.md>)

Recorded evaluation configuration: {"Memory":"Retrieval"}. This record does not assert independent reproduction.

### BIGBIRD-Pegasus

ROUGE-2: 24.05. Result ID: 698d945f8b517eb4332277b7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa690b1e209131cea1faf6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa690b1e209131cea1faf6.md>)

[Implementation](<http://goo.gle/bigbird-transformer>)

Recorded evaluation configuration: {"Model Size":"Large"}. This record does not assert independent reproduction.

### BigBird

ROUGE-2: 24.05. Result ID: 699ad1035698665ec45ffbaa.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ac91e209131cea2a36c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa690b1e209131cea1faf6.md>)

[Implementation](<http://goo.gle/bigbird-transformer>)

Recorded evaluation configuration: {"Source sequence length":1024}. This record does not assert independent reproduction.

### Random (Oracle Selection)

ROUGE-2: 23.64. Result ID: 698e0496ffc3901de09a2d83.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a0c1e209131cea25bc2.md>)

Recorded evaluation configuration: {"Strategy":"Candidate selection based on random ROUGE score"}. This record does not assert independent reproduction.

### GLM

ROUGE-2: 23.5. Result ID: 698ec505ffc3901de0a0f806.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c111e209131cea31e21.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c111e209131cea31e21.md>)

[Implementation](<https://github.com/THUDM/GLM>)

Recorded evaluation configuration: {"Backbone":"RoBERTa"}. This record does not assert independent reproduction.

### HAT-BART

ROUGE-2: 22.79. Result ID: 699ad1035698665ec45ffbad.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ac91e209131cea2a36c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ac91e209131cea2a36c.md>)

Recorded evaluation configuration: {"Source sequence length":1024}. This record does not assert independent reproduction.

### PEGFAME

ROUGE-2: 22.75. Result ID: 698dfc82ffc3901de099f561.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a011e209131cea254db.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a011e209131cea254db.md>)

[Implementation](<https://github.com/esdurmus/feqa/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### FAME

ROUGE-2: 22.75. Result ID: 698ecce0ffc3901de0a159a2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c161e209131cea320bd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a011e209131cea254db.md>)

[Implementation](<https://github.com/esdurmus/feqa/>)

Recorded evaluation configuration: {"Decoding":"Single"}. This record does not assert independent reproduction.

### FAME

ROUGE-2: 22.75. Result ID: 698ecce0ffc3901de0a159cf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c161e209131cea320bd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a011e209131cea254db.md>)

[Implementation](<https://github.com/esdurmus/feqa/>)

Recorded evaluation configuration: {"decoding\_type":"Single"}. This record does not assert independent reproduction.

### BART + TA

ROUGE-2: 22.68. Result ID: 6a042ac947f34ce924e9c1c3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ad91e209131cea2ac58.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GOLD-s

ROUGE-2: 22.58. Result ID: 698eee2f3a6c314849f3a09e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c2f1e209131cea32a8b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69751e209131cea2237f.md>)

Recorded evaluation configuration: {"Backbone":"BART","Evaluation Source":"Original Paper"}. This record does not assert independent reproduction.

### SeqCo

ROUGE-2: 22.41. Result ID: 698eee2f3a6c314849f3a09c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c2f1e209131cea32a8b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b9c1e209131cea2f4f1.md>)

Recorded evaluation configuration: {"Backbone":"BART","Evaluation Source":"Original Paper"}. This record does not assert independent reproduction.

### BART

ROUGE-2: 22.3. Result ID: 698ec505ffc3901de0a0f805.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c111e209131cea31e21.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

Recorded evaluation configuration: {"Size":"Large"}. This record does not assert independent reproduction.

### BART-Large

ROUGE-2: 22.3. Result ID: 6990f9643a6c31484904ba8a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6fa51e209131cea46dfe.md>)

Recorded evaluation configuration: {"Number of Parameters":"400M"}. This record does not assert independent reproduction.

### BART

ROUGE-2: 22.27. Result ID: 698cf8de8b517eb4331e1550.

[Reporting paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BART\_LARGE

ROUGE-2: 22.27. Result ID: 698d1a6e8b517eb4331f0a47.

[Reporting paper](<https://www.sota2.com/research/paper/68fa67211e209131cea14832.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

Recorded evaluation configuration: {"#Param":"400M","Model size":"LARGE"}. This record does not assert independent reproduction.

### Previous SOTA

ROUGE-2: 22.27. Result ID: 698d534a8b517eb43320a764.

[Reporting paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BART

ROUGE-2: 22.27. Result ID: 698d945f8b517eb4332277b0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa690b1e209131cea1faf6.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

Recorded evaluation configuration: {"Group":"Prior Art"}. This record does not assert independent reproduction.

### FINE-TUNE

ROUGE-2: 22.27. Result ID: 698d95cc8b517eb433228293.

[Reporting paper](<https://www.sota2.com/research/paper/68fa690f1e209131cea1fe0e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BART

ROUGE-2: 22.27. Result ID: 698dfc82ffc3901de099f559.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a011e209131cea254db.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BART

ROUGE-2: 22.27. Result ID: 698e0496ffc3901de09a2d7d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a0c1e209131cea25bc2.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BART

ROUGE-2: 22.27. Result ID: 698ecce0ffc3901de0a159a0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c161e209131cea320bd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

Recorded evaluation configuration: {"Decoding":"Single"}. This record does not assert independent reproduction.

### BART

ROUGE-2: 22.27. Result ID: 698eee2f3a6c314849f3a098.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c2f1e209131cea32a8b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

Recorded evaluation configuration: {"Backbone":"BART","Evaluation Source":"Original Paper"}. This record does not assert independent reproduction.

### BARTLARGE fine-tuned

ROUGE-2: 22.27. Result ID: 698f226c3a6c314849f61273.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c8b1e209131cea34a28.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

Recorded evaluation configuration: {"φ%":"100"}. This record does not assert independent reproduction.

### BART

ROUGE-2: 22.27. Result ID: 698fd62c3a6c314849fc37e3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6dbd1e209131cea3bb89.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"Fully-supervised"}. This record does not assert independent reproduction.

### BART

ROUGE-2: 22.27. Result ID: 6990133b3a6c314849fdf222.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e2c1e209131cea3e504.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

Recorded evaluation configuration: {"Number of parameters":"400M","Backbone":"BART"}. This record does not assert independent reproduction.

### BART

ROUGE-2: 22.27. Result ID: 699ad1035698665ec45ffbab.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ac91e209131cea2a36c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BART

ROUGE-2: 22.27. Result ID: 6a042ac947f34ce924e9c1c0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ad91e209131cea2ac58.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66921e209131cea10fff.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PEGASUS

ROUGE-2: 22.26. Result ID: 698dfc82ffc3901de099f55f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6a011e209131cea254db.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198c5.md>)

[Implementation](<https://github.com/google-research/pegasus>)

Recorded evaluation configuration: {"Source":"ours"}. This record does not assert independent reproduction.

### GOLD-p

ROUGE-2: 22.26. Result ID: 698eee2f3a6c314849f3a09d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c2f1e209131cea32a8b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69751e209131cea2237f.md>)

Recorded evaluation configuration: {"Backbone":"BART","Evaluation Source":"Original Paper"}. This record does not assert independent reproduction.

### Composition (FROST)

ROUGE-2: 22.24. Result ID: 698ecce0ffc3901de0a159a9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c161e209131cea320bd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c161e209131cea320bd.md>)

[Implementation](<https://github.com/google-research/language/tree/master/language/frost>)

Recorded evaluation configuration: {"Decoding":"Diverse (Composition)"}. This record does not assert independent reproduction.

Page 1 of 4. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/sota/summarization-on-xsum-test.md?metric=ROUGE-2&page=2>): Follow this link to discover more pages.
