LF Mislabeling Identification on IMDb
79.9APsource-aware IF (R-RW)
Evaluation Results
| Method | Links | |
|---|---|---|
| source-aware IF (R-RW)Labeling Model=MV2022.05 | 79.9 | |
| RWLabel Model=MV2022.05 | 78.6 | |
| source-aware IF (RW)Labeling Model=DS2022.05 | 78.5 | |
| WMLabel Model=MV2022.05 | 77.3 | |
| RWLabel Model=DS2022.05 | 77.1 | |
| source-aware IF (R-WM)Labeling Model=MV2022.05 | 76.9 | |
| LMLabel Model=MV2022.05 | 76.7 | |
| Labeling ModelLabeling Model=MV2022.05 | 76.7 | |
| source-aware IF (WM)Labeling Model=DS2022.05 | 76.4 | |
| WMLabel Model=DS2022.05 | 76.1 | |
| source-aware IF (WM)Labeling Model=MV2022.05 | 75.4 | |
| source-aware IF (RW)Labeling Model=MV2022.05 | 74 | |
| source-aware IF (RW)Labeling Model=Snorkel2022.05 | 73.7 | |
| RWLabel Model=Snorkel2022.05 | 73.2 | |
| WMLabel Model=Snorkel2022.05 | 73.2 | |
| source-aware IF (WM)Labeling Model=Snorkel2022.05 | 72.8 | |
| source-aware IF (R-RW)Labeling Model=DS2022.05 | 72.6 | |
| source-aware IF (R-RW)Labeling Model=Snorkel2022.05 | 71.3 | |
| source-aware IF (R-WM)Labeling Model=Snorkel2022.05 | 71.1 | |
| KNNLabel Model=MV2022.05 | 70.2 | |
| KNNLabeling Model=MV2022.05 | 70.2 | |
| EMLabel Model=MV2022.05 | 69.9 | |
| LMLabel Model=DS2022.05 | 69.9 | |
| EMLabel Model=DS2022.05 | 69.9 | |
| LMLabel Model=Snorkel2022.05 | 69.9 | |
| EMLabel Model=Snorkel2022.05 | 69.9 | |
| End ModelLabeling Model=MV2022.05 | 69.9 | |
| Labeling ModelLabeling Model=DS2022.05 | 69.9 | |
| End ModelLabeling Model=DS2022.05 | 69.9 | |
| Labeling ModelLabeling Model=Snorkel2022.05 | 69.9 | |
| End ModelLabeling Model=Snorkel2022.05 | 69.9 | |
| source-aware IF (R-WM)Labeling Model=DS2022.05 | 68.1 | |
| ActiveAEDhuman-in-the-loop=true2023.05 | 36.6 | |
| ActiveAEDhuman-in-the-loop=false2023.05 | 36 | |
| CU2023.05 | 31.6 | |
| DM2023.05 | 30.1 | |
| AUMaggregation=probabilities2023.05 | 30.1 | |
| AUMaggregation=raw logits2023.05 | 27.5 |