Mutation Engineering on MutaDescribe Hard set
55.19AccuracyMutaPLM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MutaPLM2024.10 | 55.19 | 43.81 | |
| ESM-2Evaluation Protocol=Fine-tuned2024.10 | 50 | 34.65 | |
| BioMedGPTEvaluation Protocol=Fine-tuned2024.10 | 39.6 | 12.62 | |
| OntoProteinEvaluation Protocol=Zero-shot2024.10 | 38.61 | 29.2 | |
| ESM-2Evaluation Protocol=Zero-shot2024.10 | 37.87 | 28.71 | |
| GPT-4-0613Number of Shots=5-shot, Retrieval Method=kNN2024.10 | 14.77 | 7.95 | |
| GPT-4-0613Number of Shots=5-shot2024.10 | 13.33 | 5.62 | |
| GPT-4-0613Number of Shots=1-shot2024.10 | 12.09 | 8.79 | |
| ProtSTBackbone=ESM-2, Evaluation Protocol=Retrieval-based2024.10 | 7.18 | — | |
| Random2024.10 | 5.2 | 1.24 |