MeSH Indexing on PMC Open Access Subset Sep 2021 (test)
74.5Micro F1KenMeSH
Evaluation Results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| KenMeSHTraining Data Scope=Abstracts and titles only2022.03 | 74.5 | — | — | — | — | — | — | — | — | — | — | 86.4 | 65.5 | 73.8 | 86.3 | 64.4 | |
| BERTMeSHTraining Data Scope=Full PMC articles2022.03 | 68.5 | — | — | — | — | — | — | — | — | — | — | 71.3 | 65.9 | 67.5 | 71.7 | 66.7 | |
| BERTMeSHTraining Data Scope=Abstracts and titles only2022.03 | 66.7 | — | — | — | — | — | — | — | — | — | — | 69.6 | 64 | 65.1 | 70 | 62.3 | |
| FullMeSHTraining Data Scope=Full PMC articles2022.03 | 64.3 | — | — | — | — | — | — | — | — | — | — | 68 | 61 | 63.9 | 68.5 | 60.1 | |
| DeepMeSHTraining Data Scope=Abstracts and titles only2022.03 | 63.9 | — | — | — | — | — | — | — | — | — | — | 66.9 | 61.2 | 63.1 | 66.7 | 62.7 | |
| HGCN4MeSHTraining Data Scope=Abstracts and titles only2022.03 | 52.4 | — | — | — | — | — | — | — | — | — | — | 76.3 | 39.9 | 52.9 | 76.2 | 40.5 | |
| MTITraining Data Scope=Abstracts and titles only2022.03 | 39 | — | — | — | — | — | — | — | — | — | — | 37.9 | 40.2 | 39.3 | 37.8 | 40.8 | |
| HGCN4MeSHInput scope=Abstracts and titles2022.03 | — | 96.1 | 87 | 78.8 | 62 | 50.1 | 7.7 | 20.4 | 30.2 | 46 | 54.9 | — | — | — | — | — | |
| KenMeSHInput scope=Abstracts and titles2022.03 | — | 99.3 | 97.2 | 93.7 | 80.1 | 65.9 | 8.1 | 23.4 | 37 | 60.3 | 72.2 | — | — | — | — | — |