Entity Matching on I-A1 10% labeled (test)
96F1 ScoreHIF+DT
Evaluation Results
| Method | Links | |
|---|---|---|
| HIF+DTlow resource setting=true, training_data_percentage=10%, KAT_algorithm=ID3 (unconstrained depth)2021.06 | 96 | |
| HIF+KATID3low resource setting=true, training_data_percentage=10%, KAT_algorithm=ID3 (max depth 3)2021.06 | 95.8 | |
| HIF-ALONElow resource setting=true, training_data_percentage=10%, ablation=removes comparison metrics2021.06 | 94.6 | |
| HIF-WBOWlow resource setting=true, training_data_percentage=10%, ablation=replaces outputs with PCA WBOW vectors2021.06 | 93 | |
| Magellanlow resource setting=true, training_data_percentage=10%, evaluation_protocol=averaged over 10 runs2021.06 | 92.3 | |
| HIF-EMBlow resource setting=true, training_data_percentage=10%, ablation=replaces outputs with mean pooling of embeddings2021.06 | 91.1 | |
| HIF+KATXGBlow resource setting=true, training_data_percentage=10%, KAT_algorithm=xgboost (max depth 3)2021.06 | 90.6 | |
| HIF+LRlow resource setting=true, training_data_percentage=10%, variation=KAT replaced with logistic regression2021.06 | 84.2 | |
| HIF+LNlow resource setting=true, training_data_percentage=10%, variation=KAT replaced with linear classifier2021.06 | 77.9 | |
| DM-RNNlow resource setting=true, training_data_percentage=10%, evaluation_protocol=averaged over 10 runs2021.06 | 63.6 | |
| HierMatcherlow resource setting=true, training_data_percentage=10%, evaluation_protocol=averaged over 10 runs2021.06 | 61.9 | |
| DM-HYBlow resource setting=true, training_data_percentage=10%, evaluation_protocol=averaged over 10 runs2021.06 | 60.9 | |
| DM-ATTlow resource setting=true, training_data_percentage=10%, evaluation_protocol=averaged over 10 runs2021.06 | 55.8 |