Reagent Prediction on USPTO (test)
12.9Exact MatchInstructMol-GS
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| InstructMol-GS2023.11 | 12.9 | 61 | 19.664 | 44.4 | 53.9 | 40 | 100 | |
| InstructMol-G2023.11 | 7 | 89 | 24.732 | 46.9 | 69.1 | 42.6 | 100 | |
| Mol-Instruction2023.11 | 4.4 | 22.4 | 23.167 | 23.7 | 36.4 | 21.3 | 100 | |
| AlpacaFew-shot ICL=true2023.11 | 0 | 2.6 | 29.037 | 2.9 | 1.6 | 0.1 | 18.6 | |
| BaizeFew-shot ICL=true2023.11 | 0 | 5.1 | 30.628 | 2.2 | 1.8 | 0.4 | 9.9 | |
| ChatGLMFew-shot ICL=true2023.11 | 0 | 1.9 | 29.169 | 1.7 | 0.6 | 0.2 | 7.4 | |
| LLamaFew-shot ICL=true2023.11 | 0 | 0.3 | 28.04 | 3.7 | 0.1 | 0.1 | 0.1 | |
| VicunaFew-shot ICL=true2023.11 | 0 | 1 | 27.948 | 3.8 | 0.2 | 0.1 | 0.7 | |
| LLama-7bTask-specific instruction fine-tuning=true, LoRA=true2023.11 | 0 | 28.3 | 53.51 | 13.6 | 29.4 | 10.6 | 100 |