Text-Molecule Retrieval on ChEBI-20 (test)
67.4Hits@1CLASS (ORMA)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CLASS (ORMA)Base Model=ORMA2025.02 | 67.4 | 93.4 | 0.774 | 17.82 | |
| ORMA2024.11 | 66.5 | 93.9 | 0.772 | 18.53 | |
| ORMAReproduced=true2025.02 | 66.4 | 93.8 | 0.776 | 19.58 | |
| Memory Bank2025.02 | 56.5 | 94.1 | 0.702 | 12.66 | |
| CLASS (AMAN)Base Model=AMAN2025.02 | 51.1 | 92.6 | 0.66 | 16.8 | |
| DSOKR - Ensemble (SubSample Sketch)Sketch type=Ensemble (SubSample), Input text encoder=SciBERT2024.06 | 51 | 88.2 | 0.642 | 76.43 | |
| DSOKR - Ensemble (Gaussian Sketch)Sketch type=Ensemble (Gaussian), Input text encoder=SciBERT2024.06 | 50.5 | 87.9 | 0.642 | 81.7 | |
| Atomas-basereproduced=true2024.11 | 50.1 | 92.1 | 0.653 | 14.49 | |
| Atomas-base2025.02 | 50.1 | 92.1 | 0.653 | 14.49 | |
| DSOKR - Ensemble (SubSample + Gaussian)Sketch type=Ensemble (SubSample + Gaussian), Input text encoder=SciBERT2024.06 | 50 | 88.3 | 0.64 | 76.87 | |
| AMAN2024.11 | 49.4 | 92.1 | 0.647 | 16.01 | |
| AMANReproduced=true2025.02 | 49.2 | 91.6 | 0.646 | 20.15 | |
| DSOKR - Gaussian SketchSketch type=Gaussian, Input text encoder=SciBERT2024.06 | 49 | 87.5 | 0.63 | 91.19 | |
| DSOKR - SubSample SketchSketch type=SubSample, Input text encoder=SciBERT2024.06 | 48.2 | 87.4 | 0.624 | 82.92 | |
| CMAM - Ensemble (MLP + GCN)Architecture=Ensemble (MLP + GCN), Input text encoder=SciBERT2024.06 | 44.2 | 88.7 | 0.597 | 16.28 | |
| CMAM - Ensemble (MLP)Architecture=Ensemble (MLP), Input text encoder=SciBERT2024.06 | 39.8 | 87.6 | 0.562 | 17.92 | |
| CMAM - Ensemble (GCN)Architecture=Ensemble (GCN), Input text encoder=SciBERT2024.06 | 39 | 87 | 0.551 | 20.48 | |
| CMAM - MLPArchitecture=MLP, Input text encoder=SciBERT2024.06 | 34.9 | 84.2 | 0.513 | 23.74 | |
| All-Ensemble2024.11 | 34.4 | 81.1 | 0.499 | 20.21 | |
| All-Ensemble2025.02 | 34.4 | 81.1 | 0.499 | 20.21 | |
| CMAM - GCNArchitecture=GCN, Input text encoder=SciBERT2024.06 | 33.2 | 82.5 | 0.495 | 24.11 | |
| MLP-Ensemble2024.11 | 29.4 | 77.6 | 0.452 | 20.78 | |
| GCN-Ensemble2024.11 | 29.4 | 77.1 | 0.447 | 28.77 | |
| MLP-Ensemble2025.02 | 29.4 | 77.6 | 0.452 | 20.78 | |
| GCN-Ensemble2025.02 | 29.4 | 77.1 | 0.447 | 28.77 | |
| MLP+Atten2024.11 | 22.8 | 68.7 | 0.375 | 30.37 | |
| MLP+Atten2025.02 | 22.8 | 68.7 | 0.375 | 30.37 | |
| MLP+FPG2024.11 | 22.6 | 68.6 | 0.374 | 30.37 | |
| MLP+FPG2025.02 | 22.6 | 68.6 | 0.374 | 30.37 | |
| SciBERT RegressionInput text encoder=SciBERT2024.06 | 16.8 | 56.9 | 0.298 | 344.53 | |
| SISOKR2024.06 | 0.4 | 2.8 | 0.015 | 2,230.48 |