Summarization on XSum (R-1, R-2, R-L)
49.02ROUGE-1Semi-offline RL
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Semi-offline RLGROUPS=SEMI, FP=N2023.06 | 49.02 | 25.37 | 40.52 | |
| BRIOGROUPS=OFFLINE, FP=NK2023.06 | 48.91 | 25.71 | 40.6 | |
| AVGGROUPS=ONLINE, FP=NTK2023.06 | 48.48 | 25.21 | 40.23 | |
| SCGROUPS=ONLINE, FP=NT2023.06 | 47.9 | 24.95 | 39.73 | |
| ACGROUPS=ONLINE, FP=NT2023.06 | 47.88 | 24.92 | 39.71 | |
| GOLDGROUPS=OFFLINE, FP=N2023.06 | 47.75 | 24.92 | 39.7 | |
| M-FTGROUPS=BASE, FP=N2023.06 | 47.65 | 24.85 | 39.56 | |
| FTGROUPS=BASE, FP=N2023.06 | 47.46 | 24.69 | 39.53 | |
| Lead-3 (at k = 3)selection strategy=fixed, k=32026.05 | 19.21 | 2.95 | 12.27 | |
| Lead-3selection strategy=fixed, k=32026.05 | 19.21 | 2.95 | 12.27 | |
| MMRselection strategy=fixed, k=32026.05 | 17.79 | 2.93 | 11.45 | |
| DPPselection strategy=fixed, k=32026.05 | 17.54 | 2.65 | 11.47 | |
| Randomselection strategy=fixed, k=32026.05 | 16.82 | 2.24 | 10.66 | |
| Centroidselection strategy=fixed, k=32026.05 | 16.79 | 2.85 | 11.16 | |
| DPP (variational k)selection strategy=variational, k=mean 7.42026.05 | 14.48 | 2.65 | 9.48 | |
| Randomselection strategy=variational, k=mean 7.42026.05 | 14.24 | 2.46 | 9.21 | |
| MMRselection strategy=variational, k=mean 7.42026.05 | 13.93 | 2.68 | 8.85 | |
| Centroidselection strategy=variational, k=mean 7.42026.05 | 13.15 | 2.59 | 8.9 |