LaMP
Benchmarks
TaskDatasetSOTA resultTrendResults
LaMP Movie (test)
100Top-1 Accuracy
14
LaMP-7 (val)
53.5ROUGE-1 Score
13
LAMP
0.648Hypervolume
10
LaMP-QA
53.27Accuracy (Arts & Entertainment)
10
LaMP News Headline
21.5ROUGE-1 Score
9
LaMP Topic Writing
0.291ROUGE-1
9
LaMP Review Writing
35.3ROUGE-1
9
LaMP Abstract Gen.
39.8ROUGE-1
9
LaMP News Headline (test)
15.1ROUGE-1
9
LaMP-4 (test)
21.1ROUGE-1
9
LaMP-3 (test)
0.242MAE
9
LaMP 1 (test)
70Accuracy
9
LaMP-5 (val)
0.487ROUGE-1
9
LaMP-4 (val)
0.216ROUGE-1
9
LaMP-7 time-based split (dev)
54.2ROUGE-1
8
LaMP-5 time-based split (dev)
49.8ROUGE-1
8
LaMP-3 time-based split (dev)
0.211MAE
8
LaMP-1 time-based split (dev)
80.9Accuracy
8
LaMP Product Rating (test)
0.318MAE
8
LaMP Movie Tagging (test)
46.39Accuracy
8
LaMP Citation Identification (test)
69.32Accuracy
8
LaMP standard (full-data)
0.735LaMP-1 Score
8
LaMP few-shot personalization setting
52LaMP-1 Accuracy
8
LaMP-4
21.2ROUGE-1
8
LaMP-1
65.6Accuracy
8