Text Generation on Mutation Explanation (temporal split)
10.83BLEU-2MutaPLM
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| MutaPLM2024.10 | 10.83 | 6.15 | 17.84 | 18.99 | 6.92 | 16.51 | |
| GPT-4-0613Few-shot settings=5-shot, Retrieval method=kNN2024.10 | 9.3 | 4.25 | 15.08 | 13.92 | 2.29 | 11.84 | |
| AugmentedESM2024.10 | 7 | 3.12 | 11.29 | 12.03 | 2.84 | 10.12 | |
| ESM-2Evaluation protocol=fine-tuned2024.10 | 6.9 | 3.83 | 13.86 | 14.21 | 4.63 | 12.62 | |
| Galactica-6.7BParameters=6.7B2024.10 | 3.5 | 1.31 | 5.61 | 7.44 | 0.85 | 6.17 | |
| ProLLaMA2024.10 | 0.69 | 0.21 | 3.33 | 0.83 | 0.04 | 0.8 | |
| Mol-Instructions2024.10 | 0.58 | 0.08 | 4.9 | 5.41 | 0.13 | 4.55 |