Reaction Diagram Parsing on RxnScribe
76.9Hard Match PrecisionMACReD(Gemini)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| MACReD(Gemini)Base Model=Gemini-2.5-Pro2026.05 | 76.9 | 73.6 | 75.2 | 87.2 | 82.1 | 84.6 | |
| MACReD(GPT)Base Model=GPT-4o2026.05 | 75.7 | 73.1 | 74.4 | 86.8 | 82.3 | 84.5 | |
| RxnIMModel Category=Trained Methods2026.05 | 74.9 | 70.1 | 72.4 | 81.9 | 77.3 | 79.5 | |
| RxnScribeModel Category=Trained Methods2026.05 | 72.3 | 66.2 | 69.1 | 83.8 | 76.5 | 80 | |
| RDE2.0Model Category=Trained Methods2026.05 | 42.1 | 41.8 | 42 | 49.5 | 49.1 | 49.4 | |
| OChemRModel Category=Trained Methods2026.05 | 4.4 | 2.8 | 3.4 | 12.4 | 7.9 | 9.6 | |
| RDEModel Category=Trained Methods2026.05 | 4.1 | 1.3 | 1.9 | 19.4 | 5.9 | 9 | |
| QwenVL-MaxModel Category=Close-source Models2026.05 | 1 | 0.5 | 0.7 | 6.4 | 6.1 | 6.2 | |
| GPT4oModel Category=Close-source Models2026.05 | 0.5 | 0.1 | 0.2 | 2.3 | 1.9 | 2.1 | |
| Qwen2.5-VL-7BModel Category=Open-source Models2026.05 | 0 | 0 | 0 | 0 | 0 | 0 | |
| InternVL3-8BModel Category=Open-source Models2026.05 | 0 | 0 | 0 | 0 | 0 | 0 | |
| MiMo-VL-7BModel Category=Open-source Models2026.05 | 0 | 0 | 0 | 0 | 0 | 0 | |
| ChemVLM-8BModel Category=Open-source Models2026.05 | 0 | 0 | 0 | 0 | 0 | 0 | |
| Intern-S1-miniModel Category=Open-source Models2026.05 | 0 | 0 | 0 | 0 | 0 | 0 | |
| Gemini-2.5-ProModel Category=Close-source Models2026.05 | 0 | 0 | 0 | 23.3 | 24.5 | 23.9 |