Regression on Beta-lactamase PEER
0.81Spearman CorrelationESM2-150M Masked-pos (run 1)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ESM2-150M Masked-pos (run 1)Backbone=ESM2-150M, Objective=Masked-pos (run 1)2026.05 | 0.81 | — | |
| ESM2-150M Masked-pos (run 2)Backbone=ESM2-150M, Objective=Masked-pos (run 2)2026.05 | 0.804 | — | |
| ProtSentModel parameters=35M, Evaluation protocol=KNN probe2026.05 | 0.793 | 18.5 | |
| ESM2-150M BaselineBackbone=ESM2-150M, Objective=Baseline2026.05 | 0.749 | — | |
| AMPLIFY-120M Masked-posBackbone=AMPLIFY-120M, Objective=Masked-pos2026.05 | 0.748 | — | |
| AMPLIFY-120M MLM-onlyBackbone=AMPLIFY-120M, Objective=MLM-only2026.05 | 0.746 | — | |
| AMPLIFY-120M All-pos MLM+JEPABackbone=AMPLIFY-120M, Objective=All-pos MLM+JEPA2026.05 | 0.746 | — | |
| ESM2-150M All-pos MLM+JEPABackbone=ESM2-150M, Objective=All-pos MLM+JEPA2026.05 | 0.74 | — | |
| ESM2-150M EMA (4h) EMABackbone=ESM2-150M EMA (4h), Objective=EMA2026.05 | 0.737 | — | |
| ProtSentModel parameters=150M, Evaluation protocol=KNN probe2026.05 | 0.733 | 0.1 | |
| ESM-2Model parameters=150M, Evaluation protocol=KNN probe2026.05 | 0.732 | — | |
| AMPLIFY-120M BaselineBackbone=AMPLIFY-120M, Objective=Baseline2026.05 | 0.718 | — | |
| ESM2-35M Masked-pos (AdamW)Backbone=ESM2-35M, Objective=Masked-pos (AdamW)2026.05 | 0.712 | — | |
| MLM+JEPA @90kBackbone=-, Objective=MLM+JEPA @90k2026.05 | 0.703 | — | |
| ESM2-35M Masked-pos (SGDm)Backbone=ESM2-35M, Objective=Masked-pos (SGDm)2026.05 | 0.685 | — | |
| ESM2-150M MLM-onlyBackbone=ESM2-150M, Objective=MLM-only2026.05 | 0.682 | — | |
| ProteinBERT2-150M masked-posBackbone=-, Objective=ProteinBERT2-150M masked-pos2026.05 | 0.671 | — | |
| ESM-2Model parameters=35M, Evaluation protocol=KNN probe2026.05 | 0.67 | — | |
| ESM2-35M BaselineBackbone=ESM2-35M, Objective=Baseline2026.05 | 0.666 | — | |
| ESM2-35M All-pos MLM+JEPABackbone=ESM2-35M, Objective=All-pos MLM+JEPA2026.05 | 0.659 | — | |
| ESM2-35M MLM-onlyBackbone=ESM2-35M, Objective=MLM-only2026.05 | 0.655 | — | |
| ProteinBERT2-35M Masked-posBackbone=ProteinBERT2-35M, Objective=Masked-pos2026.05 | 0.636 | — | |
| Rand-Init-35M Masked-posBackbone=Rand-Init-35M, Objective=Masked-pos2026.05 | 0.635 | — | |
| Rand-Init-35M MLM-onlyBackbone=Rand-Init-35M, Objective=MLM-only2026.05 | 0.593 | — | |
| AMPLIFY-120M JEPA-onlyBackbone=AMPLIFY-120M, Objective=JEPA-only2026.05 | 0.564 | — | |
| ProteinBERT2-35M All-pos MLM+JEPABackbone=ProteinBERT2-35M, Objective=All-pos MLM+JEPA2026.05 | 0.559 | — | |
| JEPA-only @90kBackbone=-, Objective=JEPA-only @90k2026.05 | 0.544 | — | |
| ESM2-150M rand-init MLM-onlyBackbone=-, Objective=ESM2-150M rand-init MLM-only2026.05 | 0.471 | — | |
| Rand-Init-35M JEPA-onlyBackbone=Rand-Init-35M, Objective=JEPA-only2026.05 | 0.467 | — | |
| Rand-Init-35M All-pos MLM+JEPABackbone=Rand-Init-35M, Objective=All-pos MLM+JEPA2026.05 | 0.452 | — | |
| ProteinBERT2-35M MLM-onlyBackbone=ProteinBERT2-35M, Objective=MLM-only2026.05 | 0.438 | — | |
| ESM2-150M JEPA-onlyBackbone=ESM2-150M, Objective=JEPA-only2026.05 | 0.401 | — | |
| ProteinBERT2-35M BaselineBackbone=ProteinBERT2-35M, Objective=Baseline2026.05 | 0.397 | — | |
| ProteinBERT2-35M JEPA-onlyBackbone=ProteinBERT2-35M, Objective=JEPA-only2026.05 | 0.334 | — | |
| Rand-Init-35M BaselineBackbone=Rand-Init-35M, Objective=Baseline2026.05 | 0.331 | — | |
| ESM2-35M JEPA-onlyBackbone=ESM2-35M, Objective=JEPA-only2026.05 | 0.296 | — |