Molecule Editing on S2-Bench (test)
92.94SR (AddComp)BioMatrix-4B
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| BioMatrix-4BRepresentation=SMILES2026.06 | 92.94 | 64.47 | 95.68 | 57.74 | 60.82 | 46 | |
| BioMatrix-4BRepresentation=SELFIES2026.06 | 91.24 | 62.72 | 96.66 | 57.24 | 59.9 | 45.01 | |
| BioMatrix-1.7BRepresentation=SMILES2026.06 | 88.16 | 61 | 95.24 | 57.6 | 60.34 | 45.56 | |
| BioMatrix-1.7BRepresentation=SELFIES2026.06 | 85.22 | 58.53 | 96.26 | 56.93 | 58.58 | 43.69 | |
| Llama3.1-8BBase Model=OpenMolIns-xlarge2026.06 | 77.9 | 52.73 | 86.4 | 53.27 | 61 | 45.35 | |
| Gemini-1.5-pro2026.06 | 70.58 | 47.94 | 75.9 | 45.15 | 71.48 | 51.03 | |
| GPT-4-turbo2026.06 | 69.9 | 48.48 | 72.44 | 41.54 | 77.78 | 56.96 | |
| Claude-3.52026.06 | 68.32 | 47.94 | 54.14 | 36.15 | 81.04 | 59.24 | |
| GPT-4o2026.06 | 61.88 | 41.97 | 70.12 | 42.34 | 79.92 | 57.74 |