Molecular Component Editing on Molecular Component Editing
74.2Average Success RateBioMedGPT-Mol
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BioMedGPT-MolModel Category=Chemistry LLM2025.12 | 74.2 | 72.9 | 88.4 | 61.3 | |
| GPT-4-turboModel Category=General LLM2025.12 | 73.4 | 69.9 | 72.4 | 77.8 | |
| Gemini-1.5-proModel Category=General LLM2025.12 | 72.6 | 70.6 | 75.9 | 71.5 | |
| GPT-4oModel Category=General LLM2025.12 | 70.6 | 61.9 | 70.1 | 79.9 | |
| Claude3.5Model Category=General LLM2025.12 | 67.8 | 68.3 | 54.1 | 81 | |
| OpenMolIns-8BModel Category=Chemistry LLM, Parameters=8B2025.12 | 54.5 | 58.2 | 51 | 54.4 | |
| OpenMolIns-125MModel Category=Chemistry LLM, Parameters=125M2025.12 | 47.5 | 58.4 | 65.3 | 18.7 | |
| Mol-T5Model Category=Task Specific, Non-LLM based2025.12 | 22.5 | 28.3 | 22.3 | 16.9 | |
| Bio-T5Model Category=Task Specific, Non-LLM based2025.12 | 19.4 | 34.6 | 16.7 | 6.8 |