ProteinGym
Benchmarks
TaskDatasetSOTA resultTrendResults
ProteinGym (overall)
0.519Spearman Correlation
43
ProteinGym substitution benchmark
0.681Average Spearman Correlation
20
ProteinGym
0.496Average Spearman Correlation
19
ProteinGym
89.74AUROC
16
ProteinGym (test)
0.509Avg. Spearman Correlation
14
ProteinGym Contig
0.7Spearman's rho
12
ProteinGym DMS 1 and 2 mutation set (2 mutation)
0.72Spearman Correlation
12
ProteinGym DMS 1 and 2 mutation set (1 mutation)
0.904Spearman Correlation
12
ProteinGym 96 DMS assays L <= 200
0.518Spearman Correlation
11
ProteinGym substitution benchmark (217 proteins) (fold 4 test)
89.74AUROC
9
ProteinGym indel
0.53Average Spearman Correlation
7
ProteinGym
0.78Spearman Correlation (GFP Stability)
7
ProteinGym (Rand split)
0.783Spearman's rho
6
ProteinGym DMS >2 mutations set (4 mutation split)
0.615Spearman Correlation
6
ProteinGym DMS (>2 mutations set) (3 mutation split)
0.652Spearman Correlation
6