Forward Synthesis on SMolInstruct
78.7Exact MatchLiterature SOTA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Literature SOTAModel Category=Task-specific, non-LLM based models2026.06 | 78.7 | 92.2 | 100 | |
| BioMatrix-4B (SMILES)Parameters=4B, Line Notation=SMILES2026.06 | 77.94 | 89.88 | 99.93 | |
| SciReasoner-8BModel Category=General / molecular LLM baselines, Parameters=8B2026.06 | 75 | — | — | |
| BioMatrix-1.7B (SMILES)Parameters=1.7B, Line Notation=SMILES2026.06 | 72.75 | 92.22 | 99.74 | |
| BioMatrix-4B (SELFIES)Parameters=4B, Line Notation=SELFIES2026.06 | 69.08 | 87.01 | 99.85 | |
| SciReasoner-1.7BModel Category=General / molecular LLM baselines, Parameters=1.7B2026.06 | 69 | — | — | |
| BioMedGPT-Mol-8BModel Category=General / molecular LLM baselines, Parameters=8B2026.06 | 67.2 | 88.5 | 99.8 | |
| LlaSMol MistralModel Category=General / molecular LLM baselines2026.06 | 63.3 | 84.9 | 99.8 | |
| LlaSMol2025.02 | 62.9 | 91.9 | — | |
| BioMatrix-1.7B (SELFIES)Parameters=1.7B, Line Notation=SELFIES2026.06 | 62.78 | 84.24 | 99.93 | |
| Mol-LLMwith_graph=true2025.02 | 60.1 | 90.8 | — | |
| Mol-LLMwith_graph=false2025.02 | 58.4 | 90.4 | — | |
| GPT-ossModel Category=General / molecular LLM baselines2026.06 | 33 | — | — | |
| BioT5+variant=Reg. & React.2025.02 | 8.1 | 53.7 | — | |
| Claude Opus 3Model Category=General / molecular LLM baselines2026.06 | 3.7 | 45.7 | 97 | |
| GPT-4Model Category=General / molecular LLM baselines2026.06 | 1.6 | 40.5 | 87 | |
| GPT-4shots=5-shot2025.02 | 1.1 | 63.4 | — | |
| Mol-Instructions2025.02 | 0.3 | 18.4 | — | |
| ChemDFM2025.02 | 0.2 | 17.8 | — | |
| MolCA2025.02 | 0 | 35.7 | — | |
| BioT5+variant=Cls. & Trans.2025.02 | 0 | 18.7 | — | |
| Galactica2025.02 | 0 | 37.7 | — | |
| 3D-MOLM2025.02 | 0 | 29.6 | — |