Reagent Prediction on Chemical Reaction-related Tasks (test)
25.7Exact Match RateBioT5+
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| BioT5+2024.02 | 25.7 | 0.695 | 12.901 | 0.539 | 0.621 | 0.512 | 100 | |
| InstructMol-GS-6.9BBackbone=Vicuna, Parameter count=6.9B2024.02 | 12.9 | 0.61 | 19.664 | 0.444 | 0.539 | 0.4 | 100 | |
| InstructMol-G-6.9BBackbone=Vicuna, Parameter count=6.9B2024.02 | 7 | 0.89 | 24.732 | 0.469 | 0.691 | 0.426 | 100 | |
| Mol-Instructions-7BBackbone=Llama-7B, Parameter count=7B, Multi-task instruction tuning=true2024.02 | 4.4 | 0.224 | 23.167 | 0.237 | 0.364 | 0.213 | 100 | |
| Llama-7BBackbone=Llama, Parameter count=7B, Zero-shot=true2024.02 | 0 | 0.003 | 28.04 | 0.037 | 0.001 | 0.001 | 0.1 | |
| Galactica-6.7BBackbone=Galactica, Parameter count=6.7B, Zero-shot=true2024.02 | 0 | 0.141 | 30.76 | 0.036 | 0.127 | 0.051 | 99.5 | |
| Text+Chem T5-223MBackbone=T5, Parameter count=223M2024.02 | 0 | 0.225 | 49.323 | 0.039 | 0.186 | 0.052 | 31.3 | |
| Llama-7B*(LORA)Backbone=Llama, Parameter count=7B, LoRA tuning=true2024.02 | 0 | 0.283 | 53.51 | 0.136 | 0.294 | 0.106 | 100 |