Protein Variant Effect Prediction on ProteinGym substitution benchmark
0.681Average Spearman CorrelationAUTOSCIENTISTS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| AUTOSCIENTISTSModel type=Kermut2026.05 | 0.681 | 0.607 | |
| KermutModel type=Kermut2026.05 | 0.633 | 0.666 | |
| ProteinNPTModel type=NPT2026.05 | 0.588 | 0.765 | |
| MSA Transformer EmbeddingsModel type=Embed.2026.05 | 0.562 | 0.783 | |
| Tranception EmbeddingsModel type=Embed.2026.05 | 0.525 | 0.849 | |
| AIDO Protein-RAG (16B)Input Modalities=Structure & MSA2026.04 | 0.518 | — | |
| VenusREMInput Modalities=Structure & MSA2026.04 | 0.518 | — | |
| ESM-1v EmbeddingsModel type=Embed.2026.05 | 0.514 | 0.848 | |
| ProSST (K=2048)Input Modalities=Seq. & Structure2026.04 | 0.507 | — | |
| S3F-MSAInput Modalities=Structure & MSA2026.04 | 0.496 | — | |
| ProtrieverInput Modalities=MSA2026.04 | 0.479 | — | |
| ESCOTTInput Modalities=Structure & MSA2026.04 | 0.476 | — | |
| S3FInput Modalities=Seq. & Structure2026.04 | 0.47 | — | |
| ProFam (ensemble)Input Modalities=MSA2026.04 | 0.47 | — | |
| PoET (200M)Input Modalities=MSA2026.04 | 0.47 | — | |
| ESM3 open (1.4B)Input Modalities=Seq. Str. & Func.2026.04 | 0.466 | — | |
| DPLM-EvoSetting=with GEMME alignment2026.04 | 0.459 | — | |
| GEMMEInput Modalities=MSA2026.04 | 0.455 | — | |
| EVE (ensemble)Input Modalities=MSA2026.04 | 0.439 | — | |
| DPLM-EvoSetting=single-sequence setting2026.04 | 0.42 | — |