Molecule Captioning on Mol-Instructions
0.766ROUGE-LCuttlefish
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Cuttlefish2026.02 | 0.766 | — | — | — | — | 0.715 | |
| Mol-LLama-3.1Base Model=Llama-3.12026.02 | 0.759 | — | — | — | — | 0.707 | |
| Mol-LLama-2Base Model=Llama-22026.02 | 0.75 | — | — | — | — | 0.701 | |
| Mol-Ins.-Llama-3.1Base Model=Llama-3.12026.02 | 0.709 | — | — | — | — | 0.637 | |
| Text+Chem T5 (augm-base)training_mode=full fine-tuning2023.11 | 0.622 | 0.625 | 0.542 | 0.682 | 0.543 | 0.648 | |
| MolCAtraining_mode=full fine-tuning2023.11 | 0.618 | 0.62 | 0.531 | 0.681 | 0.537 | 0.651 | |
| MolT5-largetraining_mode=full fine-tuning2023.11 | 0.594 | 0.594 | 0.508 | 0.654 | 0.51 | 0.614 | |
| Qwen-2.5-7BModel Size=7B2026.02 | 0.572 | — | — | — | — | 0.538 | |
| Instruct-Gtraining_mode=full fine-tuning2023.11 | 0.541 | 0.653 | 0.566 | 0.608 | 0.445 | 0.562 | |
| Mol-Ins.-Llama-2Base Model=Llama-22026.02 | 0.291 | — | — | — | — | 0.291 | |
| ChatGLM-6BModel Size=6B2026.02 | 0.166 | — | — | — | — | 0.129 | |
| Baize-7BModel Size=7B2026.02 | 0.148 | — | — | — | — | 0.106 | |
| Llama-3-8BModel Size=8B2026.02 | 0.148 | — | — | — | — | 0.184 | |
| Alpaca-7BModel Size=7B2026.02 | 0.136 | — | — | — | — | 0.107 | |
| Vicuna-v1.5-13BModel Size=13B2026.02 | 0.13 | — | — | — | — | 0.168 | |
| Galactica-6.7BModel Size=6.7B2026.02 | 0.063 | — | — | — | — | 0.065 | |
| MolT52026.02 | 0.034 | — | — | — | — | 0.033 |