SMILES parsing on CleanMol
99.56FG AccuracyMolBasic
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| MolBasicTask type=SFT2026.07 | 99.56 | 97.74 | 99.46 | 88.36 | |
| Qwen2.5-7B (Multi)Task type=SFT2026.07 | 99.01 | 87.5 | 99.02 | 92.62 | |
| Llama3.1-8B (Multi)Task type=SFT2026.07 | 98.91 | 87.07 | 98.51 | 94.63 | |
| Qwen2.5-7B (Single)Task type=SFT2026.07 | 98.91 | 86.74 | 99.07 | 75.93 | |
| Llama3.1-8B (Single)Task type=SFT2026.07 | 94.14 | 86.12 | 98.59 | 93.56 | |
| Deepseek-V3-chatTask type=5-shot2026.07 | 89.12 | 62.66 | 29.76 | 14.84 | |
| GPT-4oTask type=5-shot2026.07 | 87.5 | 59.55 | 28.57 | 10.78 | |
| Galactica-6.7BTask type=5-shot2026.07 | 50 | 7.32 | 15.11 | 0 |