Solubility Prediction on DeepSol
0.752ROC AUCMLM-only
Evaluation Results
| Method | Links | |
|---|---|---|
| MLM-onlyBackbone=Rand-Init-35M2026.05 | 0.752 | |
| ProteinBERT2-150M masked-posBackbone=Not specified2026.05 | 0.748 | |
| Masked-posBackbone=Rand-Init-35M2026.05 | 0.742 | |
| Masked-posBackbone=ProteinBERT2-35M2026.05 | 0.739 | |
| ESM2-150M rand-init MLM-onlyBackbone=Not specified2026.05 | 0.732 | |
| All-pos MLM+JEPABackbone=ESM2-150M2026.05 | 0.729 | |
| EMA (4h)Backbone=ESM2-150M2026.05 | 0.725 | |
| Masked-pos (run 1)Backbone=ESM2-150M2026.05 | 0.724 | |
| BaselineBackbone=ESM2-150M2026.05 | 0.721 | |
| Masked-pos (run 2)Backbone=ESM2-150M2026.05 | 0.721 | |
| MLM-onlyBackbone=ESM2-150M2026.05 | 0.718 | |
| All-pos MLM+JEPABackbone=ESM2-35M2026.05 | 0.714 | |
| JEPA-only @90kBackbone=Not specified2026.05 | 0.712 | |
| Masked-pos (AdamW)Backbone=ESM2-35M2026.05 | 0.71 | |
| MLM+JEPA @90kBackbone=Not specified2026.05 | 0.706 | |
| MLM-onlyBackbone=ESM2-35M2026.05 | 0.704 | |
| Masked-pos (SGDm)Backbone=ESM2-35M2026.05 | 0.703 | |
| Masked-posBackbone=AMPLIFY-120M2026.05 | 0.702 | |
| MLM-onlyBackbone=AMPLIFY-120M2026.05 | 0.698 | |
| BaselineBackbone=ESM2-35M2026.05 | 0.697 | |
| All-pos MLM+JEPABackbone=ProteinBERT2-35M2026.05 | 0.696 | |
| JEPA-onlyBackbone=ESM2-150M2026.05 | 0.693 | |
| All-pos MLM+JEPABackbone=AMPLIFY-120M2026.05 | 0.692 | |
| BaselineBackbone=AMPLIFY-120M2026.05 | 0.685 | |
| JEPA-onlyBackbone=AMPLIFY-120M2026.05 | 0.681 | |
| All-pos MLM+JEPABackbone=Rand-Init-35M2026.05 | 0.677 | |
| BaselineBackbone=ProteinBERT2-35M2026.05 | 0.672 | |
| MLM-onlyBackbone=ProteinBERT2-35M2026.05 | 0.658 | |
| BaselineBackbone=Rand-Init-35M2026.05 | 0.657 | |
| JEPA-onlyBackbone=Rand-Init-35M2026.05 | 0.653 | |
| JEPA-onlyBackbone=ProteinBERT2-35M2026.05 | 0.634 | |
| JEPA-onlyBackbone=ESM2-35M2026.05 | 0.595 |