Chemical Structure Recognition on hand-drawn images (test)
63.5Acc (T=1)ChemExpert
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ChemExpertensemble_components=DECIMER fine-tuned [25] + AtomLenz+EditKT*2024.04 | 63.5 | 0.749 | — | |
| ChemExpert([25],AtomLenz+EditKT*)expert_models=[DECIMER fine-tuned [25]|AtomLenz+EditKT*]2024.04 | 63.5 | 0.749 | 57.9 | |
| ChemExpert([25],[24])expert_models=[DECIMER fine-tuned [25]|DECIMER [24]]2024.04 | 62.6 | 0.738 | 57.1 | |
| DECIMER fine-tunedversion=v2.2.02024.04 | 62.2 | 0.727 | — | |
| DECIMER fine-tunedversion=v2.2.0, fine-tuned=true2024.04 | 62.2 | 0.727 | 56.7 | |
| ChemExpert(AtomLenz+EditKT*,[25])expert_models=[AtomLenz+EditKT*|DECIMER fine-tuned [25]]2024.04 | 41.7 | 0.572 | 41.6 | |
| AtomLenz+EditKT*training_data=enriched with atom-level entity localization2024.04 | 33.8 | 0.484 | — | |
| AtomLenz+EditKT*knowledge transfer=EditKT*2024.04 | 33.8 | 0.484 | 27.9 | |
| DECIMERversion=v2.2.02024.04 | 29.5 | 0.451 | — | |
| DECIMERversion=v2.2.02024.04 | 29.5 | 0.451 | 28.1 | |
| MolScribe2024.04 | 10.2 | 0.288 | — | |
| MolScribe2024.04 | 10.2 | 0.288 | 9.4 | |
| Img2Mol2024.04 | 8.4 | 0.275 | — | |
| Img2Mol2024.04 | 8.4 | 0.275 | 4.7 | |
| AtomLenz2024.04 | 0.9 | 0.087 | — | |
| AtomLenz2024.04 | 0.9 | 0.087 | 0.8 | |
| OSRA2024.04 | 0.6 | 0.065 | — | |
| OSRA2024.04 | 0.6 | 0.065 | 0.6 | |
| ChemGrapher2024.04 | 0.2 | 0.065 | — | |
| ChemGrapher2024.04 | 0.2 | 0.065 | 0.2 |