Column Type Annotation on SOTAB-27
0.643Micro-F1ArcheType
Evaluation Results
| Method | Links | |
|---|---|---|
| ArcheTypeArch=GPT, Source Category=CLOSED-SOURCE, Zero-shot=true2023.10 | 0.643 | |
| ArcheTypeArch=T5, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 0.608 | |
| C-BaselineArch=GPT, Source Category=CLOSED-SOURCE, Zero-shot=true2023.10 | 0.585 | |
| ArcheTypeArch=UL2, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 0.58 | |
| K-BaselineArch=GPT, Source Category=CLOSED-SOURCE, Zero-shot=true2023.10 | 0.572 | |
| K-BaselineArch=UL2, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 0.525 | |
| K-BaselineArch=T5, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 0.521 | |
| C-BaselineArch=UL2, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 0.513 | |
| C-BaselineArch=T5, Source Category=OPEN-SOURCE, Zero-shot=true2023.10 | 0.5 |