LaMP
Benchmarks
TaskDatasetSOTA resultTrendResults
LaMP-4 1.0 (test)
0.188ROUGE-1
8
LAMP 7 OOD
47.9ROUGE-1
7
LAMP-5 OOD
49.5R-1 Score
7
LAMP-2M (OOD)
54.3Accuracy
7
LaMP-7 (random)
44.2ROUGE-1
7
LaMP-5 (random)
49ROUGE-1
7
LaMP 3 (random)
0.281MAE
7
LaMP 2M (random)
44.2Accuracy
7
LaMP-2N (random)
78.1Accuracy
7
LaMP-1 (random)
58.3Accuracy
7
LaMP-7 (test)
52.1ROUGE-1
7
LaMP-5 (test)
49R-1 Score
7
LaMP-3 (test)
0.27MAE
7
LaMP-1 (test)
69Accuracy
7
LaMP-5
47.7ROUGE
5
LaMP-4
21.8ROUGE
5
LAMP Generation
0.67Hypervolume
5
LaMP
44.32ROUGE-L (Average)
5
LaMP
16.1ROUGE-L (Average)
5
LaMP-3 (Cold-start)
0.301MAE
4
LaMP-2N Cold-start
75.6Accuracy
4
LaMP-2M (Cold-start)
47.6Accuracy
4
LaMP-1 (Cold-start)
84.5Accuracy
4
LaMP 4
17.9ROUGE@N=30
4
LaMP-7 1.0 (test)
0.448ROUGE-1
4