Mutation Engineering on MutaDescribe (Easy set)
56.08AccuracyMutaPLM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MutaPLM2024.10 | 56.08 | 43.47 | |
| ESM-2Evaluation Protocol=Fine-tuned2024.10 | 52.17 | 35.65 | |
| OntoProteinEvaluation Protocol=Zero-shot2024.10 | 39.78 | 28.91 | |
| ESM-2Evaluation Protocol=Zero-shot2024.10 | 35.21 | 23.91 | |
| BioMedGPTEvaluation Protocol=Fine-tuned2024.10 | 35.21 | 7.82 | |
| GPT-4-0613Number of Shots=5-shot, Retrieval Method=kNN2024.10 | 15.97 | 7.56 | |
| GPT-4-0613Number of Shots=5-shot2024.10 | 14.84 | 4.68 | |
| GPT-4-0613Number of Shots=1-shot2024.10 | 10.83 | 5 | |
| ProtSTBackbone=ESM-2, Evaluation Protocol=Retrieval-based2024.10 | 5.86 | — | |
| Random2024.10 | 5.23 | 0.83 |