IUPAC Name to SMILES Conversion on SpecMol-Bench v1.0 (test)
0.9959Token AccuracySTOUT v1.0
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| STOUT v1.0type=Specialized Tool2025.09 | 0.9959 | 0.59 | 0.59 | |
| OPSINtype=Specialized Tool2025.09 | 0.9943 | 0.98 | 0.98 | |
| ChemDFM-v2.0-14Btype=Task-Specific Specialist Model2025.09 | 0.7868 | 0.78 | 0.78 | |
| InternS1-235Btype=Task-Specific Specialist Model2025.09 | 0.6168 | 0.51 | 0.51 | |
| Gemini-3-Flashtype=LLM-based Generalist Model2025.09 | 0.5491 | 0.3333 | 0.3333 | |
| SpecMol-7B2025.09 | 0.4607 | 0.45 | 0.45 | |
| GPT-5type=LLM-based Generalist Model2025.09 | 0.4591 | 0.28 | 0.28 | |
| o3-minitype=LLM-based Generalist Model2025.09 | 0.4119 | 0.18 | 0.18 | |
| KIMI-K2type=LLM-based Generalist Model2025.09 | 0.4015 | 0.22 | 0.22 | |
| DeepSeek-V3-685Btype=LLM-based Generalist Model2025.09 | 0.3907 | 0.12 | 0.12 | |
| Qwen3-235Btype=LLM-based Generalist Model2025.09 | 0.152 | 0 | 0 | |
| Qwen2.5-7Bvariant=Base, type=LLM-based Generalist Model2025.09 | 0.0595 | 0 | 0 | |
| Galactica-6.7Btype=Task-Specific Specialist Model2025.09 | 0.0528 | 0.01 | 0.01 |