Column Type Annotation on Pubchem-15
63.3Micro-F1ArcheType
Evaluation results
| Method | Links | |
|---|---|---|
| ArcheTypeArch=T5, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 63.3 | |
| ArcheTypeArch=UL2, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 61.1 | |
| ArcheTypeArch=GPT, Source Category=CLOSED-SOURCE, Zero-shot=true2023.10 | 60.2 | |
| C-BaselineArch=T5, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 59 | |
| K-BaselineArch=GPT, Source Category=CLOSED-SOURCE, Zero-shot=true2023.10 | 55.8 | |
| K-BaselineArch=UL2, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 54.7 | |
| K-BaselineArch=T5, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 51.3 | |
| C-BaselineArch=UL2, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 50.3 | |
| C-BaselineArch=GPT, Source Category=CLOSED-SOURCE, Zero-shot=true2023.10 | 43 |