SMILES to IUPAC Name Conversion on SpecMol-Bench v1.0 (test)
41.52Token AccuracyChemDFM-v2.0-14B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ChemDFM-v2.0-14Btype=Task-Specific Specialist Model2025.09 | 41.52 | 20 | 38 | |
| STOUT v1.0type=Specialized Tool2025.09 | 38.38 | 19 | 30 | |
| SpecMol-7B2025.09 | 37.64 | 20 | 29 | |
| InternS1-235Btype=Task-Specific Specialist Model2025.09 | 33.73 | 39 | 39 | |
| Gemini-3-Flashtype=LLM-based Generalist Model2025.09 | 21.61 | 3.06 | 6 | |
| KIMI-K2type=LLM-based Generalist Model2025.09 | 13.09 | 1 | 1 | |
| GPT-5type=LLM-based Generalist Model2025.09 | 12.01 | 1 | 6 | |
| o3-minitype=LLM-based Generalist Model2025.09 | 11.94 | 1 | 1 | |
| DeepSeek-V3-685Btype=LLM-based Generalist Model2025.09 | 5.81 | 0 | 0 | |
| Qwen3-235Btype=LLM-based Generalist Model2025.09 | 4.75 | 0 | 0 | |
| Qwen2.5-7Bvariant=Base, type=LLM-based Generalist Model2025.09 | 2.94 | 0 | 0 | |
| Galactica-6.7Btype=Task-Specific Specialist Model2025.09 | 1.72 | 0 | 0 |