Semantic Type Classification on VizNet (test)
0.925Support-weighted F1DCoM-Single-DistilBERT
Evaluation Results
| Method | Links | |
|---|---|---|
| DCoM-Single-DistilBERTEngineered Features=Yes, k=10, Runtime (s)=1.552 ± 0.01, Size (MB)=268.22021.06 | 0.925 | |
| DCoM-Single-DistilBERTEngineered Features=Yes, k=1, Runtime (s)=0.162 ± 0.01, Size (MB)=268.22021.06 | 0.922 | |
| DCoM-Single-ElectraEngineered Features=Yes, k=10, Runtime (s)=0.894 ± 0.01, Size (MB)=53.12021.06 | 0.909 | |
| DCoM-Single-ElectraEngineered Features=Yes, k=1, Runtime (s)=0.093 ± 0.01, Size (MB)=53.12021.06 | 0.907 | |
| DCoM-Single-DistilBERTEngineered Features=No, k=10, Runtime (s)=1.492 ± 0.01, Size (MB)=202.32021.06 | 0.904 | |
| DCoM-Single-DistilBERTEngineered Features=No, k=1, Runtime (s)=0.158 ± 0.01, Size (MB)=202.32021.06 | 0.901 | |
| DCoM-Single-LSTMEngineered Features=Yes, k=10, Runtime (s)=0.152 ± 0.01, Size (MB)=112.12021.06 | 0.898 | |
| DCoM-Single-LSTMEngineered Features=Yes, k=1, Runtime (s)=0.019 ± 0.01, Size (MB)=112.12021.06 | 0.895 | |
| DCoM-Single-ElectraEngineered Features=No, k=10, Runtime (s)=0.887 ± 0.01, Size (MB)=45.72021.06 | 0.892 | |
| DCoM-Single-ElectraEngineered Features=No, k=1, Runtime (s)=0.092 ± 0.01, Size (MB)=45.72021.06 | 0.89 | |
| SherlockEngineered Features=-, Runtime (s)=0.42 ± 0.01, Size (MB)=6.22021.06 | 0.89 | |
| DCoM-Multi-LSTMEngineered Features=Yes, k=10, Runtime (s)=0.416 ± 0.01, Size (MB)=4.72021.06 | 0.881 | |
| DCoM-Multi-LSTMEngineered Features=Yes, k=1, Runtime (s)=0.046 ± 0.01, Size (MB)=4.72021.06 | 0.878 | |
| DCoM-Single-LSTMEngineered Features=No, k=10, Runtime (s)=0.141 ± 0.01, Size (MB)=97.82021.06 | 0.877 | |
| DCoM-Single-LSTMEngineered Features=No, k=1, Runtime (s)=0.018 ± 0.01, Size (MB)=97.82021.06 | 0.871 | |
| DCoM-Multi-LSTMEngineered Features=No, k=10, Runtime (s)=0.401 ± 0.01, Size (MB)=4.62021.06 | 0.871 | |
| DCoM-Multi-LSTMEngineered Features=No, k=1, Runtime (s)=0.044 ± 0.01, Size (MB)=4.62021.06 | 0.869 | |
| Random ForestEngineered Features=-, Runtime (s)=0.26 ± 0.01, Size (MB)=760.42021.06 | 0.84 | |
| Decision treeEngineered Features=-, Runtime (s)=0.26 ± 0.01, Size (MB)=59.12021.06 | 0.76 | |
| ConsensusEngineered Features=-, Runtime (s)=33.74 ± 0.86, Size (MB)=-2021.06 | 0.32 | |
| DictionaryEngineered Features=-, Runtime (s)=0.01 ± 0.03, Size (MB)=0.52021.06 | 0.16 | |
| Regular expressionEngineered Features=-, Runtime (s)=0.01 ± 0.03, Size (MB)=0.012021.06 | 0.04 |