Mutation Engineering on MutaDescribe Average
53.51AccuracyMutaPLM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MutaPLM2024.10 | 53.51 | 40.94 | |
| ESM-2Evaluation Protocol=Fine-tuned2024.10 | 51.43 | 33.77 | |
| OntoProteinEvaluation Protocol=Zero-shot2024.10 | 38.37 | 28.12 | |
| ESM-2Evaluation Protocol=Zero-shot2024.10 | 35.84 | 25.15 | |
| BioMedGPTEvaluation Protocol=Fine-tuned2024.10 | 35.73 | 8.72 | |
| GPT-4-0613Number of Shots=5-shot, Retrieval Method=kNN2024.10 | 15.06 | 7.56 | |
| GPT-4-0613Number of Shots=5-shot2024.10 | 12.65 | 5.63 | |
| GPT-4-0613Number of Shots=1-shot2024.10 | 11.21 | 6.81 | |
| ProtSTBackbone=ESM-2, Evaluation Protocol=Retrieval-based2024.10 | 6.49 | — | |
| Random2024.10 | 5.13 | 0.87 |