Molecule Question Answering on MoleculeQA
83.36Structure ScoreBioMatrix-4B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| BioMatrix-4BMolecule Representation=SMILES2026.06 | 83.36 | 77.96 | 47.88 | 46.24 | 73.78 | |
| BioMatrix-4BMolecule Representation=SELFIES2026.06 | 83.26 | 76.55 | 47.2 | 45.58 | 73.24 | |
| BioMatrix-1.7BMolecule Representation=SMILES2026.06 | 79.28 | 74.76 | 43.23 | 44.41 | 70.07 | |
| BioMatrix-1.7BMolecule Representation=SELFIES2026.06 | 79.05 | 75.06 | 43.91 | 44.91 | 70.15 | |
| MolSight# Trainable Params=90.4M2026.07 | 78.38 | 73.42 | 51.16 | 50.42 | 70.9 | |
| MolCA-1.3B2026.06 | 71.12 | 70.98 | 47.81 | 43.17 | 64.79 | |
| MolCA-1.3B# Trainable Params=110M2026.07 | 71.12 | 70.98 | 47.81 | 43.17 | 64.79 | |
| BioT5-base2026.06 | 65.98 | 69.24 | 49.11 | 40.73 | 62.03 | |
| BioT5-base# Trainable Params=252M2026.07 | 65.98 | 69.24 | 49.11 | 40.73 | 62.03 | |
| MolCA-125M# Trainable Params=100M2026.07 | 65.54 | 67.34 | 45.77 | 40.33 | 60.3 | |
| MoMu-base2026.06 | 61.58 | 65.3 | 43.78 | 43.07 | 57.43 | |
| MoMu-base# Trainable Params=252M2026.07 | 61.58 | 65.3 | 43.78 | 43.07 | 57.43 | |
| GPT-4-1106-preview2026.06 | 60.94 | 50.19 | 35.57 | 43.91 | 53.47 | |
| GPT-4-1106-previewEvaluation Protocol=10-shot2026.07 | 60.94 | 50.19 | 35.57 | 43.91 | 53.47 | |
| T5-base# Trainable Params=220M2026.07 | 60.42 | 66.42 | 45.83 | 43.74 | 58.24 | |
| MolT5-base2026.06 | 58.01 | 65.85 | 45.14 | 42.24 | 55.39 | |
| MolT5-base# Trainable Params=250M2026.07 | 58.01 | 65.85 | 45.14 | 42.24 | 55.39 | |
| BioMedGPT-LM-7B2026.06 | 54.19 | 60.01 | 38.85 | 40.9 | 52.23 | |
| BioMedGPT-LM-7B# Trainable Params=40M2026.07 | 54.19 | 60.01 | 38.85 | 40.9 | 52.23 | |
| OPT-350M# Trainable Params=331M2026.07 | 44.39 | 60.83 | 46.24 | 40.57 | 48.05 | |
| Pythia-6.9B# Trainable Params=29.4M2026.07 | 42.79 | 58.9 | 38.58 | 39.07 | 45.61 | |
| Mol-Instructions-7B2026.06 | 37.46 | 47.36 | 32.69 | 29.88 | 38.37 | |
| Mol-Instruction-7B# Trainable Params=40M2026.07 | 37.46 | 47.36 | 32.69 | 29.88 | 38.37 | |
| Vicuna-v1.5-13B# Trainable Params=63M2026.07 | 37.01 | 43.19 | 30.64 | 31.55 | 37.07 | |
| BLOOM-7.1B# Trainable Params=27.5M2026.07 | 35.01 | 47.51 | 31.46 | 33.56 | 37.31 | |
| Llama-2-13B-chat# Trainable Params=63M2026.07 | 34.37 | 43.86 | 31.05 | 29.72 | 35.67 | |
| Galactica-6.7B2026.06 | 32.35 | 41.92 | 31.05 | 28.21 | 33.96 | |
| GALACTICA-6.7B# Trainable Params=12.5M2026.07 | 32.35 | 41.92 | 31.05 | 28.21 | 33.96 | |
| GPT-3.5-1106-turbo2026.06 | 25.6 | 37.6 | 28.04 | 32.22 | 29.29 | |
| Random2026.07 | 24.41 | 22.3 | 23.04 | 24.57 | 24.03 | |
| Mixtral-8×7B-Instruct-v0.1Evaluation Protocol=10-shot2026.07 | 23.32 | 31.87 | 32.89 | 29.96 | 27.79 |