Forward Reaction Prediction on USPTO (test)
53.6Exact MatchInstructMol-GS
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| InstructMol-GS2023.11 | 53.6 | 96.7 | 10.851 | 77.6 | 87.8 | 74.1 | 100 | |
| Text+ChemT5Domain expert method=true2023.11 | 45.4 | 60.2 | 26.545 | 72.9 | 77.3 | 70 | 85.1 | |
| InstructMol-G2023.11 | 15.3 | 90.6 | 20.155 | 51.9 | 71.7 | 45.7 | 100 | |
| Mol-Instruction2023.11 | 4.5 | 65.4 | 27.262 | 31.3 | 50.9 | 26.2 | 100 | |
| LLama-7bTask-specific instruction fine-tuning=true, LoRA=true2023.11 | 1.2 | 80.4 | 29.947 | 49.9 | 64.9 | 40.7 | 100 | |
| AlpacaFew-shot ICL=true2023.11 | 0 | 6.5 | 41.989 | 0.4 | 2.4 | 0.8 | 13.8 | |
| BaizeFew-shot ICL=true2023.11 | 0 | 4.4 | 41.5 | 0.4 | 2.5 | 0.9 | 9.7 | |
| ChatGLMFew-shot ICL=true2023.11 | 0 | 18.3 | 40.008 | 5 | 10 | 4.4 | 10.8 | |
| LLamaFew-shot ICL=true2023.11 | 0 | 2 | 42.002 | 0.1 | 0.2 | 0.1 | 3.9 | |
| VicunaFew-shot ICL=true2023.11 | 0 | 5.7 | 41.69 | 0.7 | 1.6 | 0.6 | 5.9 | |
| Molecular TransformerDomain expert method=true2023.11 | 0 | 47.6 | 45.979 | 76.1 | 67.3 | 54 | 100 |