Molecule Captioning on SMolInstruct (test)
0.582BLEU-4BioT5+*
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BioT5+*Model category=Semi-Generalist Models, Task objective=Cls. & Trans.2025.02 | 0.582 | 0.644 | 0.677 | |
| MolCA*Model category=Specialist Models2025.02 | 0.51 | 0.604 | 0.628 | |
| Mol-LLMModel category=Generalist Models, Graph input configuration=Full model2025.02 | 0.482 | 0.433 | 0.589 | |
| Mol-LLMModel category=Generalist Models, Graph input configuration=w/o Graph2025.02 | 0.477 | 0.49 | 0.585 | |
| MolT5Model category=Specialist Models2025.02 | 0.366 | 0.501 | 0.515 | |
| LlaSMol*Model category=Generalist Models2025.02 | 0.328 | 0.465 | 0.47 | |
| BioT5+*Model category=Semi-Generalist Models, Task objective=Reg. & React.2025.02 | 0.221 | 0.364 | 0.321 | |
| 3D-MOLM*Model category=Generalist Models2025.02 | 0.167 | 0.285 | 0.329 | |
| GPT-4Model category=Generalist Models, Protocol=5-shot2025.02 | 0.125 | 0.273 | 0.274 | |
| ChemDFM*Model category=Generalist Models2025.02 | 0.035 | 0.108 | 0.085 | |
| Mol-InstructionsModel category=Semi-Generalist Models2025.02 | 0.02 | 0.217 | 0.124 | |
| Galactica*Model category=Generalist Models2025.02 | 0 | 0.006 | 0.005 |