List your company
ResearchFormerly WizWand

Text Summarization on CNN/DM (ROUGE-2)

16.95ROUGE-213B (Multi-Task Tuning)
6.82049.450212.0814.7098Jun 17, 2024
Updated 8mo ago

Evaluation results

MethodLinks
13B (Multi-Task Tuning)Tuning=Multi-task2024.0616.95
7B (Multi-Task Tuning)Context=Multi-task transfer from 7B2024.0616.3
7B-Expert (CNN/DM)Tuning=Single-task2024.0615.21
1.1B (Multi-Task Tuning)Context=Multi-task transfer from 1.1B2024.0614.26
1.1B-Expert (CNN/DM)Tuning=Single-task2024.0614.22
7B-Expert (GSM8K)Tuning=Single-task2024.0611.19
7B-Expert (TruthfulQA)Tuning=Single-task2024.0611.02
Proxy TuningContext=Multi-task transfer from 7B2024.0610.52
7B-Expert (TriviaQA)Tuning=Single-task2024.0610.3
Proxy TuningContext=Multi-task transfer from 1.1B2024.069.38
13B (Base)Model Type=Pre-trained2024.068.94
7B (Base)Model Type=Pre-trained2024.068.81
1.1B-Expert (TriviaQA)Tuning=Single-task2024.068.03
1.1B-Expert (GSM8K)Tuning=Single-task2024.067.75
1.1B-Expert (TruthfulQA)Tuning=Single-task2024.067.23
1.1B (Base)Model Type=Pre-trained2024.067.21