Molecule-to-IUPAC translation on Mol2IUPAC (test)
77.11BLEU-4Qwen3-4B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen3-4BArchitecture=Decoder-Only2026.07 | 77.11 | |
| Qwen3-1.7BArchitecture=Decoder-Only2026.07 | 76.49 | |
| Qwen3-0.6BArchitecture=Decoder-Only2026.07 | 75.51 | |
| Galactica-125MArchitecture=Decoder-Only2026.07 | 72.31 | |
| BioT5-baseArchitecture=Encoder-Decoder2026.07 | 59.69 | |
| MolT5-largeArchitecture=Encoder-Decoder2026.07 | 45.58 | |
| ChemLLM-7BGED perturbation level (k)=Raw, Fine-tuning protocol=standard fine-tuning2026.07 | 42.68 | |
| ChemLLM-7BArchitecture=Decoder-Only2026.07 | 42.68 | |
| LLaMA-3.2-1BGED perturbation level (k)=Raw, Fine-tuning protocol=standard fine-tuning2026.07 | 38.43 | |
| LLaMA-3.2-1BArchitecture=Decoder-Only2026.07 | 38.43 | |
| MolT5-baseArchitecture=Encoder-Decoder2026.07 | 36.56 | |
| MolT5-smallArchitecture=Encoder-Decoder2026.07 | 34.64 | |
| LLaMA-3.2-1BGED perturbation level (k)=k=1, Fine-tuning protocol=standard fine-tuning2026.07 | 25 | |
| LLaMA-3.2-1BGED perturbation level (k)=k=2, Fine-tuning protocol=standard fine-tuning2026.07 | 22.44 | |
| LLaMA-3.2-1BGED perturbation level (k)=k=3, Fine-tuning protocol=standard fine-tuning2026.07 | 21.92 | |
| LLaMA-3.2-1BGED perturbation level (k)=k=4, Fine-tuning protocol=standard fine-tuning2026.07 | 21.2 | |
| LLaMA-3.2-1BGED perturbation level (k)=k=5, Fine-tuning protocol=standard fine-tuning2026.07 | 20.98 | |
| ChemLLM-7BGED perturbation level (k)=k=1, Fine-tuning protocol=standard fine-tuning2026.07 | 19.91 | |
| ChemLLM-7BGED perturbation level (k)=k=2, Fine-tuning protocol=standard fine-tuning2026.07 | 17.97 | |
| ChemLLM-7BGED perturbation level (k)=k=3, Fine-tuning protocol=standard fine-tuning2026.07 | 17.43 | |
| ChemLLM-7BGED perturbation level (k)=k=4, Fine-tuning protocol=standard fine-tuning2026.07 | 16.9 | |
| ChemLLM-7BGED perturbation level (k)=k=5, Fine-tuning protocol=standard fine-tuning2026.07 | 16.58 |