Identifying Mislabeling of Labeling Functions on DomainNet sketch
0.813APsource-aware IF (R-RW)
Evaluation Results
| Method | Links | |
|---|---|---|
| source-aware IF (R-RW)Labeling Model=MV2022.05 | 0.813 | |
| source-aware IF (RW)Labeling Model=MV2022.05 | 0.764 | |
| source-aware IF (WM)Labeling Model=MV2022.05 | 0.718 | |
| source-aware IF (R-WM)Labeling Model=MV2022.05 | 0.718 | |
| source-aware IF (R-RW)Labeling Model=DS2022.05 | 0.515 | |
| source-aware IF (R-RW)Labeling Model=Snorkel2022.05 | 0.515 | |
| source-aware IF (RW)Labeling Model=DS2022.05 | 0.506 | |
| source-aware IF (RW)Labeling Model=Snorkel2022.05 | 0.497 | |
| source-aware IF (WM)Labeling Model=DS2022.05 | 0.46 | |
| source-aware IF (WM)Labeling Model=Snorkel2022.05 | 0.455 | |
| source-aware IF (R-WM)Labeling Model=Snorkel2022.05 | 0.433 | |
| source-aware IF (R-WM)Labeling Model=DS2022.05 | 0.432 | |
| Labeling ModelLabeling Model=MV2022.05 | 0.339 | |
| KNNLabeling Model=MV2022.05 | 0.321 | |
| End ModelLabeling Model=MV2022.05 | 0.316 | |
| Labeling ModelLabeling Model=DS2022.05 | 0.316 | |
| End ModelLabeling Model=DS2022.05 | 0.316 | |
| Labeling ModelLabeling Model=Snorkel2022.05 | 0.316 | |
| End ModelLabeling Model=Snorkel2022.05 | 0.316 |