Element-specific Counting on PubChem-STM (test)
0.339Mean Absolute ErrorMolBasic
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MolBasic2026.07 | 0.339 | 73.01 | |
| MolBasic2026.07 | 0.383 | 82.9 | |
| Qwen3-8B2026.07 | 2.982 | 51.86 | |
| ChemLLMModel Version=7B2026.07 | 3.763 | 42.1 | |
| InternLM3Model Version=8B2026.07 | 3.902 | 40.98 | |
| Qwen3-8B2026.07 | 7.674 | 45.81 | |
| InternLM3Model Version=8B2026.07 | 8.105 | 26.34 | |
| VicunaModel Version=7B2026.07 | 8.511 | 11.49 | |
| ChatGLMModel Version=3-6B2026.07 | 9.127 | 12.22 | |
| MolT5Model Version=Large2026.07 | 9.287 | 3.3 | |
| VicunaModel Version=7B2026.07 | 9.8 | 22.58 | |
| MolT5Model Version=Large2026.07 | 9.833 | 2.5 | |
| T5Model Version=Large2026.07 | 9.882 | 0.13 | |
| T5Model Version=Large2026.07 | 10.227 | 2.81 | |
| ChatGLMModel Version=3-6B2026.07 | 10.557 | 14.12 | |
| ChemLLMModel Version=7B2026.07 | 36.67 | 5.76 |