Molecule Captioning on Mol-Instructions (test)
0.143BLEUMol-Instructions-8B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Mol-Instructions-8BTraining=Trained with entire instructions (Upper Bound), Backbone=LLaMA3.1-8B2024.12 | 0.143 | 0.254 | 0.196 | 0.291 | |
| PEIT-LLM-LLaMa3.1-8BBackbone=LLaMa3.1-8B2024.12 | 0.053 | 0.215 | 0.125 | 0.184 | |
| PEIT-LLM-Qwen2.5-7BBackbone=Qwen2.5-7B2024.12 | 0.051 | 0.208 | 0.121 | 0.178 | |
| Text+Chem T5-223MModel size=223M2024.12 | 0.036 | 0.139 | 0.075 | 0.119 | |
| LLaMa3.1-8BModel size=8B2024.12 | 0.014 | 0.184 | 0.066 | 0.148 | |
| Vicuna-7BModel size=7B2024.12 | 0.011 | 0.168 | 0.055 | 0.13 | |
| ChatGLM-6BModel size=6B2024.12 | 0.011 | 0.105 | 0.066 | 0.148 | |
| Qwen2.5-7BModel size=7B2024.12 | 0.009 | 0.169 | 0.047 | 0.119 | |
| Galactica-6.7BModel size=6.7B2024.12 | 0.008 | 0.065 | 0.015 | 0.063 | |
| MolT5-248MModel size=248M2024.12 | 0.001 | 0.033 | 0.001 | 0.034 |