Protein Fitness Prediction on ProteinGym (test)
0.5087Avg. Spearman CorrelationProSST (K=2048) + ProteinTTT
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ProSST (K=2048) + ProteinTTTK-cluster=2048, Customization=ProteinTTT, Evaluation Protocol=Zero-shot2024.11 | 0.5087 | 0.4822 | 0.447 | 0.5321 | 0.4315 | 0.6507 | |
| ProSST (K=2048)K-cluster=2048, Customization=None, Evaluation Protocol=Zero-shot2024.11 | 0.5068 | 0.4758 | 0.4448 | 0.5302 | 0.4306 | 0.6526 | |
| SaProt (650M) + ProteinTTTModel Parameters=650M, Customization=ProteinTTT, Evaluation Protocol=Zero-shot2024.11 | 0.4583 | 0.4593 | 0.379 | 0.4883 | 0.3754 | 0.5896 | |
| SaProt (650M)Model Parameters=650M, Customization=None, Evaluation Protocol=Zero-shot2024.11 | 0.4569 | 0.4584 | 0.3785 | 0.4884 | 0.367 | 0.5919 | |
| ESM2 (650M) + ProteinTTTModel Parameters=650M, Customization=ProteinTTT, Evaluation Protocol=Zero-shot2024.11 | 0.4153 | 0.4323 | 0.3376 | 0.4168 | 0.3702 | 0.5195 | |
| ESM2 (650M)Model Parameters=650M, Customization=None, Evaluation Protocol=Zero-shot2024.11 | 0.4139 | 0.4254 | 0.3366 | 0.4151 | 0.3691 | 0.5233 | |
| SaProt (35M) + ProteinTTTModel Parameters=35M, Customization=ProteinTTT, Evaluation Protocol=Zero-shot2024.11 | 0.4106 | 0.3783 | 0.3569 | 0.443 | 0.2955 | 0.5795 | |
| SaProt (35M)Model Parameters=35M, Customization=None, Evaluation Protocol=Zero-shot2024.11 | 0.4062 | 0.3721 | 0.3568 | 0.439 | 0.2879 | 0.5749 | |
| ProGen2-large (2.7B) + ProteinTTTModel Parameters=2.7B, Customization=ProteinTTT, Evaluation Protocol=Zero-shot2024.11 | 0.3817 | 0.4091 | 0.3113 | 0.4227 | 0.3661 | 0.3993 | |
| ProGen2-large (2.7B)Model Parameters=2.7B, Customization=None, Evaluation Protocol=Zero-shot2024.11 | 0.3724 | 0.4001 | 0.282 | 0.4184 | 0.3711 | 0.3904 | |
| ProGen2-small (151M) + ProteinTTTModel Parameters=151M, Customization=ProteinTTT, Evaluation Protocol=Zero-shot2024.11 | 0.3591 | 0.3827 | 0.296 | 0.3875 | 0.3302 | 0.3992 | |
| ESM2 (35M) + ProteinTTTModel Parameters=35M, Customization=ProteinTTT, Evaluation Protocol=Zero-shot2024.11 | 0.3407 | 0.3407 | 0.2942 | 0.355 | 0.2403 | 0.4733 | |
| ProGen2-small (151M)Model Parameters=151M, Customization=None, Evaluation Protocol=Zero-shot2024.11 | 0.3255 | 0.3316 | 0.2681 | 0.373 | 0.3283 | 0.3264 | |
| ESM2 (35M)Model Parameters=35M, Customization=None, Evaluation Protocol=Zero-shot2024.11 | 0.3211 | 0.3137 | 0.2907 | 0.3435 | 0.2184 | 0.4392 |