Chemical Structure Recognition on ChemPix out of domain (test)
48.7Exact Match AccuracyChemExpert
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ChemExpertEnsemble Components=DECIMER fine-tuned [25], AtomLenz+EditKT*2024.04 | 48.7 | 51.8 | 65.5 | |
| DECIMER (v2.2.0)Fine-tuning=true2024.04 | 48.2 | 50.8 | 64.3 | |
| ChemExpertEnsemble Components=AtomLenz+EditKT*, DECIMER fine-tuned [25]2024.04 | 44.1 | 52.9 | 65 | |
| ChemExpertEnsemble Components=AtomLenz+EditKT*, MolScribe [23]2024.04 | 41.2 | 50 | 61.9 | |
| AtomLenzKnowledge Transfer (EditKT*)=true2024.04 | 40 | 48.4 | 60.5 | |
| MolScribe2024.04 | 22.8 | 26.9 | 41.7 | |
| ChemGrapher2024.04 | 15.1 | 18.7 | 28.6 | |
| OSRA2024.04 | 4.4 | 4.7 | 7.1 | |
| DECIMER (v2.2.0)2024.04 | 3.6 | 5 | 10 | |
| AtomLenz2024.04 | 2.6 | 5.4 | 6.4 | |
| Img2Mol2024.04 | 1.5 | 1.5 | 8.4 |