List your company
ResearchFormerly WizWand

LF Mislabeling Identification on IMDb

79.9APsource-aware IF (R-RW)
25.40439.55253.767.848May 25, 2022Jul 25, 2022Sep 25, 2022Nov 26, 2022Jan 27, 2023Mar 30, 2023May 31, 2023
Updated 8mo ago

Evaluation results

MethodLinks
source-aware IF (R-RW)Labeling Model=MV2022.0579.9
RWLabel Model=MV2022.0578.6
source-aware IF (RW)Labeling Model=DS2022.0578.5
WMLabel Model=MV2022.0577.3
RWLabel Model=DS2022.0577.1
source-aware IF (R-WM)Labeling Model=MV2022.0576.9
LMLabel Model=MV2022.0576.7
Labeling ModelLabeling Model=MV2022.0576.7
source-aware IF (WM)Labeling Model=DS2022.0576.4
WMLabel Model=DS2022.0576.1
source-aware IF (WM)Labeling Model=MV2022.0575.4
source-aware IF (RW)Labeling Model=MV2022.0574
source-aware IF (RW)Labeling Model=Snorkel2022.0573.7
RWLabel Model=Snorkel2022.0573.2
WMLabel Model=Snorkel2022.0573.2
source-aware IF (WM)Labeling Model=Snorkel2022.0572.8
source-aware IF (R-RW)Labeling Model=DS2022.0572.6
source-aware IF (R-RW)Labeling Model=Snorkel2022.0571.3
source-aware IF (R-WM)Labeling Model=Snorkel2022.0571.1
KNNLabel Model=MV2022.0570.2
KNNLabeling Model=MV2022.0570.2
EMLabel Model=MV2022.0569.9
LMLabel Model=DS2022.0569.9
EMLabel Model=DS2022.0569.9
LMLabel Model=Snorkel2022.0569.9
EMLabel Model=Snorkel2022.0569.9
End ModelLabeling Model=MV2022.0569.9
Labeling ModelLabeling Model=DS2022.0569.9
End ModelLabeling Model=DS2022.0569.9
Labeling ModelLabeling Model=Snorkel2022.0569.9
End ModelLabeling Model=Snorkel2022.0569.9
source-aware IF (R-WM)Labeling Model=DS2022.0568.1
ActiveAEDhuman-in-the-loop=true2023.0536.6
ActiveAEDhuman-in-the-loop=false2023.0536
CU2023.0531.6
DM2023.0530.1
AUMaggregation=probabilities2023.0530.1
AUMaggregation=raw logits2023.0527.5