Retrosynthesis on USPTO (test)
0.536Exact MatchRetroformer-untyped
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Retroformer-untypedDomain expert method=true2023.11 | 0.536 | 0.881 | 10.277 | 0.865 | 0.904 | 0.83 | 99.5 | |
| InstructMol-GS2023.11 | 0.407 | 0.941 | 13.967 | 0.753 | 0.852 | 0.714 | 100 | |
| InstructMol-G2023.11 | 0.114 | 0.586 | 21.271 | 0.422 | 0.523 | 0.285 | 100 | |
| Text+ChemT5Domain expert method=true2023.11 | 0.033 | 0.314 | 88.672 | 0.457 | 0.469 | 0.35 | 63.2 | |
| Mol-Instruction2023.11 | 0.009 | 0.705 | 31.227 | 0.283 | 0.487 | 0.23 | 100 | |
| AlpacaFew-shot ICL=true2023.11 | 0 | 0.063 | 46.915 | 0.005 | 0.023 | 0.007 | 16 | |
| BaizeFew-shot ICL=true2023.11 | 0 | 0.095 | 44.714 | 0.025 | 0.05 | 0.023 | 11.2 | |
| ChatGLMFew-shot ICL=true2023.11 | 0 | 0.117 | 48.365 | 0.056 | 0.075 | 0.043 | 4.6 | |
| LLamaFew-shot ICL=true2023.11 | 0 | 0.036 | 46.844 | 0.018 | 0.029 | 0.017 | 1 | |
| VicunaFew-shot ICL=true2023.11 | 0 | 0.057 | 46.877 | 0.025 | 0.03 | 0.021 | 1.7 | |
| LLama-7bTask-specific instruction fine-tuning=true, LoRA=true2023.11 | 0 | 0.283 | 53.51 | 0.136 | 0.294 | 0.106 | 100 |