Mislabel detection on Weak Reference Labels Mislabels
84.3AP4PL Δℓi (proposed)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| 4PL Δℓi (proposed)Criterion=Forced-ceiling likelihood ratio2026.05 | 84.3 | 98 | 95 | |
| top-10 disagreement2026.05 | 76.1 | 89 | 91.5 | |
| plain 4PL, single-stage (low di)Model=4PL, Protocol=single-stage, Selection=low difficulty2026.05 | 71.8 | 92.1 | 89.5 | |
| XGBoost (4PL params)Model=XGBoost, Features=4PL parameters2026.05 | 71.7 | 93 | 90 | |
| 4PL, low diModel=4PL, Selection=low difficulty2026.05 | 70.3 | 95 | 87 | |
| low riSelection=low response probability2026.05 | 69.4 | 98 | 88 | |
| plain 2PL (low ai)Model=2PL, Selection=low discrimination2026.05 | 64.2 | 95 | 72.5 | |
| GLAD2026.05 | 62.2 | 94 | 81.5 | |
| overall disagreement2026.05 | 53.3 | 80 | 73.5 |