# Mislabel Detection on vehicle Source: [Mislabel Detection on vehicle]() Collection index: [llms.txt]() Data updated: 2026-05-21T12:27:54.566Z Evaluation of model performance in detecting mislabeled data within the vehicle dataset, typically measured using AUROC. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Mislabel Detection | | Dataset (including any stated split) | vehicle | | Metric | AUROC | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [AUROC](): Higher is better; unit: SCALAR. ## Recorded results | Method | AUROC | Result date | Report paper | | --- | --- | --- | --- | | KNN | 0.853 | Not recorded | 69facb43c0f56ed84308a5d2 | | LSH-Shapley | 0.82 | Not recorded | 69facb43c0f56ed84308a5d2 | | G-Shapley | 0.569 | Not recorded | 69facb43c0f56ed84308a5d2 | | DS | 0.551 | Not recorded | 69facb43c0f56ed84308a5d2 | | DB | 0.491 | Not recorded | 69facb43c0f56ed84308a5d2 | | inf | 0.26 | Not recorded | 6a0e91b3f984739ed6738c58 | | sv-soft | 0.13 | Not recorded | 6a0e91b3f984739ed6738c58 | | sv | 0.11 | Not recorded | 6a0e91b3f984739ed6738c58 | | sv-mc | 0.11 | Not recorded | 6a0e91b3f984739ed6738c58 | | sv-uw | 0.11 | Not recorded | 6a0e91b3f984739ed6738c58 | | bv-mc | 0.1 | Not recorded | 6a0e91b3f984739ed6738c58 | | loo | 0.1 | Not recorded | 6a0e91b3f984739ed6738c58 | | beta-mc | 0.09 | Not recorded | 6a0e91b3f984739ed6738c58 | | bv-fast | 0.08 | Not recorded | 6a0e91b3f984739ed6738c58 | | bv-uw | 0.08 | Not recorded | 6a0e91b3f984739ed6738c58 | | rand | 0.07 | Not recorded | 6a0e91b3f984739ed6738c58 | | lava | 0.03 | Not recorded | 6a0e91b3f984739ed6738c58 | ### KNN AUROC: 0.853. Result ID: 69faf8eb47f34ce924ddd041. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"N":"10,000","d":"100"}. This record does not assert independent reproduction. ### LSH-Shapley AUROC: 0.82. Result ID: 69faf8eb47f34ce924ddd042. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"N":"10,000","d":"100"}. This record does not assert independent reproduction. ### G-Shapley AUROC: 0.569. Result ID: 69faf8eb47f34ce924ddd03e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"N":"10,000","d":"100"}. This record does not assert independent reproduction. ### DS AUROC: 0.551. Result ID: 69faf8eb47f34ce924ddd03f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"N":"10,000","d":"100"}. This record does not assert independent reproduction. ### DB AUROC: 0.491. Result ID: 69faf8eb47f34ce924ddd040. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"N":"10,000","d":"100"}. This record does not assert independent reproduction. ### inf AUROC: 0.26. Result ID: 6a0efa34fbc373592c07808b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### sv-soft AUROC: 0.13. Result ID: 6a0efa34fbc373592c078088. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"variant":"soft"}. This record does not assert independent reproduction. ### sv AUROC: 0.11. Result ID: 6a0efa34fbc373592c078085. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### sv-mc AUROC: 0.11. Result ID: 6a0efa34fbc373592c078086. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"variant":"mc"}. This record does not assert independent reproduction. ### sv-uw AUROC: 0.11. Result ID: 6a0efa34fbc373592c078087. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"variant":"uw"}. This record does not assert independent reproduction. ### bv-mc AUROC: 0.1. Result ID: 6a0efa34fbc373592c078083. [Reporting paper]() Recorded evaluation configuration: {"variant":"mc"}. This record does not assert independent reproduction. ### loo AUROC: 0.1. Result ID: 6a0efa34fbc373592c07808c. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### beta-mc AUROC: 0.09. Result ID: 6a0efa34fbc373592c078089. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"variant":"mc"}. This record does not assert independent reproduction. ### bv-fast AUROC: 0.08. Result ID: 6a0efa34fbc373592c078082. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"variant":"fast"}. This record does not assert independent reproduction. ### bv-uw AUROC: 0.08. Result ID: 6a0efa34fbc373592c078084. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"variant":"uw"}. This record does not assert independent reproduction. ### rand AUROC: 0.07. Result ID: 6a0efa34fbc373592c07808d. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### lava AUROC: 0.03. Result ID: 6a0efa34fbc373592c07808a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.