Forward Reaction Prediction on Chemical Reaction-related Tasks (test)
0.864Exact MatchBioT5+
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| BioT5+2024.02 | 0.864 | 0.993 | 3.403 | 0.949 | 0.975 | 0.935 | 100 | |
| InstructMol-GS-6.9BBackbone=Vicuna, Parameter count=6.9B2024.02 | 0.536 | 0.967 | 10.851 | 0.776 | 0.878 | 0.741 | 100 | |
| Text+Chem T5-223MBackbone=T5, Parameter count=223M2024.02 | 0.239 | 0.782 | 20.413 | 0.705 | 0.789 | 0.652 | 76.2 | |
| InstructMol-G-6.9BBackbone=Vicuna, Parameter count=6.9B2024.02 | 0.153 | 0.906 | 20.155 | 0.519 | 0.717 | 0.457 | 100 | |
| Mol-Instructions-7BBackbone=Llama-7B, Parameter count=7B, Multi-task instruction tuning=true2024.02 | 0.045 | 0.654 | 27.262 | 0.313 | 0.509 | 0.262 | 100 | |
| Llama-7B*(LORA)Backbone=Llama, Parameter count=7B, LoRA tuning=true2024.02 | 0.012 | 0.804 | 29.947 | 0.499 | 0.649 | 0.407 | 100 | |
| Llama-7BBackbone=Llama, Parameter count=7B, Zero-shot=true2024.02 | 0 | 0.02 | 42.002 | 0.001 | 0.002 | 0.001 | 3.9 | |
| Galactica-6.7BBackbone=Galactica, Parameter count=6.7B, Zero-shot=true2024.02 | 0 | 0.468 | 35.021 | 0.156 | 0.257 | 0.097 | 94.6 |