Column Type Annotation on Pubchem-20+
72Micro F1ArcheType
Evaluation Results
| Method | Links | |
|---|---|---|
| ArcheTypeArch=T5, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 72 | |
| ArcheTypeArch=UL2, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 70.9 | |
| C-BaselineArch=T5, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 68.3 | |
| ArcheTypeArch=GPT, Source Category=CLOSED-SOURCE, Zero-shot=true2023.10 | 65.9 | |
| K-BaselineArch=GPT, Source Category=CLOSED-SOURCE, Zero-shot=true2023.10 | 65.8 | |
| K-BaselineArch=UL2, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 64.8 | |
| K-BaselineArch=T5, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 62.3 | |
| C-BaselineArch=UL2, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 61.7 | |
| C-BaselineArch=GPT, Source Category=CLOSED-SOURCE, Zero-shot=true2023.10 | 56 |