Molecule Description Generation on ChEBI-20 2022 (test)
0.666BLEU-2BioT5+
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| BioT5+Model Category=LLM-based Generalist Models2024.02 | 0.666 | 0.591 | 0.71 | 0.584 | 0.65 | 0.681 | |
| MolCAModel Category=Single-task Specialist Models2024.02 | 0.639 | 0.555 | 0.697 | 0.558 | 0.636 | 0.669 | |
| BioT5Model Category=Single-task Specialist Models2024.02 | 0.635 | 0.556 | 0.692 | 0.559 | 0.633 | 0.656 | |
| Text+Chem T5Model Category=Single-task Specialist Models2024.02 | 0.625 | 0.542 | 0.682 | 0.543 | 0.622 | 0.648 | |
| GPT-4-0314Model Category=Retrieval Based LLMs, Few-shot settings=10-shot, Framework=MolReGPT2024.02 | 0.607 | 0.525 | 0.634 | 0.476 | 0.562 | 0.61 | |
| MolXPTModel Category=Single-task Specialist Models2024.02 | 0.594 | 0.505 | 0.66 | 0.511 | 0.597 | 0.626 | |
| MolFMModel Category=Single-task Specialist Models, Backbone=MolT5-base2024.02 | 0.585 | 0.498 | 0.653 | 0.508 | 0.594 | 0.607 | |
| GPT-3.5-turboModel Category=Retrieval Based LLMs, Few-shot settings=10-shot, Framework=MolReGPT2024.02 | 0.565 | 0.482 | 0.623 | 0.45 | 0.543 | 0.585 | |
| MoMuModel Category=Single-task Specialist Models, Backbone=MolT5-base2024.02 | 0.549 | 0.462 | — | — | 0.576 | — | |
| MoT5-baseModel Category=Single-task Specialist Models2024.02 | 0.54 | 0.457 | 0.634 | 0.485 | 0.568 | 0.569 | |
| T5-baseModel Category=Single-task Specialist Models2024.02 | 0.511 | 0.423 | 0.607 | 0.451 | 0.55 | 0.539 | |
| InstructMol-GS-6.9BModel Category=LLM-based Generalist Models, Number of Parameters=6.9B2024.02 | 0.475 | 0.371 | 0.566 | 0.394 | 0.502 | 0.509 | |
| InstructMol-G-6.9BModel Category=LLM-based Generalist Models, Number of Parameters=6.9B2024.02 | 0.466 | 0.365 | 0.547 | 0.365 | 0.479 | 0.491 | |
| GIT-Mol-(graph+SMILES)Model Category=Single-task Specialist Models, Input Modality=graph+SMILES2024.02 | 0.352 | 0.263 | 0.575 | 0.485 | 0.56 | 0.43 | |
| GIT-Mol-graphModel Category=Single-task Specialist Models, Input Modality=graph2024.02 | 0.29 | 0.21 | 0.54 | 0.445 | 0.512 | 0.491 | |
| GIT-Mol-SMILESModel Category=Single-task Specialist Models, Input Modality=SMILES2024.02 | 0.264 | 0.176 | 0.477 | 0.374 | 0.451 | 0.43 | |
| Mol-Instructions-7BModel Category=LLM-based Generalist Models, Number of Parameters=7B2024.02 | 0.249 | 0.171 | 0.331 | 0.203 | 0.289 | 0.271 | |
| BioMedGPT-10BModel Category=LLM-based Generalist Models, Number of Parameters=10B2024.02 | 0.234 | 0.141 | 0.386 | 0.206 | 0.332 | 0.308 | |
| GPT-3.5-turboModel Category=LLM-based Generalist Models, Few-shot settings=zero-shot2024.02 | 0.103 | 0.05 | 0.261 | 0.088 | 0.204 | 0.161 | |
| TransformerModel Category=Single-task Specialist Models2024.02 | 0.061 | 0.027 | 0.204 | 0.087 | 0.186 | 0.114 |