Entity Matching on Walmart-Amazon (WA) (test)
95.7F1 ScoreSudowoodo
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SudowoodoTraining=Fully-supervised, Record Repair=false2022.07 | 95.7 | — | — | |
| SudowoodoTraining=Fully-supervised, Record Repair=true2022.07 | 93.3 | — | — | |
| Kimi K2.6Matching Strategy=Zero-shot direct matching2026.06 | 90.54 | 4.88 | 3.29 | |
| GPT-5.2Matching Strategy=Zero-shot direct matching2026.06 | 88.78 | — | — | |
| Ditto (Best m.l. set)Model=Ditto (RoBERTa), Training Set=Machine-labeled (Best strategy)2026.06 | 87.25 | — | — | |
| DittoTraining=Fully-supervised2022.07 | 86.8 | — | — | |
| Qwen 3.6 PlusMatching Strategy=Zero-shot direct matching2026.06 | 85.71 | — | — | |
| Ditto (Benchmark set)Model=Ditto (RoBERTa), Training Set=Gold Benchmark2026.06 | 85.66 | — | — | |
| DeepMatcherTraining=Fully-supervised2022.07 | 73.6 | — | — | |
| RotomLabel Budget=7502022.07 | 68.5 | — | — | |
| DeepMatcherLabel Budget=Full2022.07 | 67.6 | — | — | |
| SudowoodoLabel Budget=5002022.07 | 66.1 | — | — | |
| DittoLabel Budget=7502022.07 | 65.7 | — | — | |
| SudowoodoLabel Budget=500, Ablation configuration=-cut,-RR,-cls2022.07 | 65.6 | — | — | |
| SudowoodoLabel Budget=500, Ablation configuration=-cls2022.07 | 65.5 | — | — | |
| SudowoodoLabel Budget=500, Ablation configuration=-RR2022.07 | 64.3 | — | — | |
| Sudowoodo (-cut,-RR,-cls)Learning Protocol=unsupervised, Optimization Modules=Pseudo-labeling (PL) only2022.07 | 63.3 | — | — | |
| SudowoodoLabel Budget=500, Ablation configuration=-cut,-RR2022.07 | 62.8 | — | — | |
| SudowoodoLabel Budget=500, Ablation configuration=-cut2022.07 | 62.8 | — | — | |
| Auto-FuzzyJoinLearning Protocol=unsupervised2022.07 | 61.3 | — | — | |
| SudowoodoLearning Protocol=unsupervised, Optimization Modules=All (PL, Cls, Cut, RR)2022.07 | 61.2 | — | — | |
| ZeroERLearning Protocol=unsupervised2022.07 | 51 | — | — | |
| RotomLabel Budget=5002022.07 | 50.1 | — | — | |
| DittoLabel Budget=5002022.07 | 49.4 | — | — | |
| SimCLRLabel Budget=5002022.07 | 41.1 | — | — | |
| SudowoodoLabel Budget=500, Ablation configuration=-PL2022.07 | 40.6 | — | — |