# Mislabel Detection on fraud Source: [Mislabel Detection on fraud]() Collection index: [llms.txt]() Data updated: 2026-05-21T12:27:54.514Z Evaluation of model performance in detecting mislabeled instances within the 'fraud' dataset, measured using AUROC. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Mislabel Detection | | Dataset (including any stated split) | fraud | | Metric | AUROC | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [AUROC](): Higher is better; unit: PERCENT. ## Recorded results | Method | AUROC | Result date | Report paper | | --- | --- | --- | --- | | KNN | 95.2 | Not recorded | 69facb43c0f56ed84308a5d2 | | LSH-Shapley | 94.1 | Not recorded | 69facb43c0f56ed84308a5d2 | | G-Shapley | 76.6 | Not recorded | 69facb43c0f56ed84308a5d2 | | DS | 58.5 | Not recorded | 69facb43c0f56ed84308a5d2 | | DB | 49.1 | Not recorded | 69facb43c0f56ed84308a5d2 | | sv-soft | 34 | Not recorded | 6a0e91b3f984739ed6738c58 | | inf | 28 | Not recorded | 6a0e91b3f984739ed6738c58 | | beta-mc | 22 | Not recorded | 6a0e91b3f984739ed6738c58 | | bv-mc | 12 | Not recorded | 6a0e91b3f984739ed6738c58 | | bv-fast | 11 | Not recorded | 6a0e91b3f984739ed6738c58 | | bv-uw | 11 | Not recorded | 6a0e91b3f984739ed6738c58 | | sv-mc | 11 | Not recorded | 6a0e91b3f984739ed6738c58 | | sv | 10 | Not recorded | 6a0e91b3f984739ed6738c58 | | sv-uw | 10 | Not recorded | 6a0e91b3f984739ed6738c58 | | rand | 5 | Not recorded | 6a0e91b3f984739ed6738c58 | | loo | 4 | Not recorded | 6a0e91b3f984739ed6738c58 | | lava | 0 | Not recorded | 6a0e91b3f984739ed6738c58 | ### KNN AUROC: 95.2. Result ID: 69faf8eb47f34ce924ddd02d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"N":"10,000","d":"30"}. This record does not assert independent reproduction. ### LSH-Shapley AUROC: 94.1. Result ID: 69faf8eb47f34ce924ddd02e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"N":"10,000","d":"30"}. This record does not assert independent reproduction. ### G-Shapley AUROC: 76.6. Result ID: 69faf8eb47f34ce924ddd02a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"N":"10,000","d":"30"}. This record does not assert independent reproduction. ### DS AUROC: 58.5. Result ID: 69faf8eb47f34ce924ddd02b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"N":"10,000","d":"30"}. This record does not assert independent reproduction. ### DB AUROC: 49.1. Result ID: 69faf8eb47f34ce924ddd02c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"N":"10,000","d":"30"}. This record does not assert independent reproduction. ### sv-soft AUROC: 34. Result ID: 6a0efa34fbc373592c078058. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"variant":"soft"}. This record does not assert independent reproduction. ### inf AUROC: 28. Result ID: 6a0efa34fbc373592c07805b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### beta-mc AUROC: 22. Result ID: 6a0efa34fbc373592c078059. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"variant":"mc"}. This record does not assert independent reproduction. ### bv-mc AUROC: 12. Result ID: 6a0efa34fbc373592c078053. [Reporting paper]() Recorded evaluation configuration: {"variant":"mc"}. This record does not assert independent reproduction. ### bv-fast AUROC: 11. Result ID: 6a0efa34fbc373592c078052. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"variant":"fast"}. This record does not assert independent reproduction. ### bv-uw AUROC: 11. Result ID: 6a0efa34fbc373592c078054. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"variant":"uw"}. This record does not assert independent reproduction. ### sv-mc AUROC: 11. Result ID: 6a0efa34fbc373592c078056. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"variant":"mc"}. This record does not assert independent reproduction. ### sv AUROC: 10. Result ID: 6a0efa34fbc373592c078055. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### sv-uw AUROC: 10. Result ID: 6a0efa34fbc373592c078057. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"variant":"uw"}. This record does not assert independent reproduction. ### rand AUROC: 5. Result ID: 6a0efa34fbc373592c07805d. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### loo AUROC: 4. Result ID: 6a0efa34fbc373592c07805c. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### lava AUROC: 0. Result ID: 6a0efa34fbc373592c07805a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.