Column Type Annotation on SOTAB (original train)
90.87PrecisionRoBERTa
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| RoBERTashots=3562023.06 | 90.87 | 87.7 | 89.73 | 0.26 | |
| ChatGPT (zero-shot two-step approach)shots=02023.06 | 90.08 | 86.6 | 89.47 | — | |
| RoBERTashots=16002023.06 | 87.59 | 87.6 | 86.79 | -2.68 | |
| RoBERTashots=1592023.06 | 82.41 | 81.79 | 79.2 | -10.27 | |
| Random Forestshots=3562023.06 | 70.98 | 59.49 | 59.6 | -29.87 | |
| DODUOshots=16002023.06 | 63.02 | 41.36 | 53.6 | -35.87 | |
| RoBERTashots=322023.06 | 49.13 | 52.25 | 48.93 | -40.54 | |
| Random Forestshots=1592023.06 | 38.36 | 43.75 | 46.15 | -43.32 | |
| DODUOshots=3562023.06 | 1.95 | 48.92 | 6.37 | -83.1 |