# Kernel Density Machines

Source: [Kernel Density Machines](<https://www.sota2.com/research/paper/68fa5d9c1e209131ce9db8aa>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-28T05:00:04.913Z

Authors: Andrea Della Vecchia, Damir Filipovic, Paul Schneider

Published: 2025-04-30T08:25:25.000Z

## Abstract

We introduce kernel density machines (KDM), an agnostic kernel-based framework for learning the Radon-Nikodym derivative (density) between probability measures under minimal assumptions. KDM applies to general measurable spaces and avoids the structural requirements common in classical nonparametric density estimators. We construct a sample estimator and prove its consistency and a functional central limit theorem. To enable scalability, we develop Nystrom-type low-rank approximations and derive optimal error rates, filling a gap in the literature where such guarantees for density learning have been missing. We demonstrate the versatility of KDM through applications to kernel-based two-sample testing and conditional distribution estimation, the latter enjoying dimension-free guarantees beyond those of locally smoothed methods. Experiments on simulated and real data show that KDM is accurate, scalable, and competitive across a range of tasks.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Independence testing on W distribution (test)](<https://www.sota2.com/research/sota/independence-testing-on-w-distribution-test.md>): Independence testing; W distribution (test); Rejection Rate: 0.74.

- [Independence testing on IndependentClouds (test)](<https://www.sota2.com/research/sota/independence-testing-on-independentclouds-test.md>): Independence testing; IndependentClouds (test); Rejection Rate: 5.

- [Independence testing on Circle distribution (test)](<https://www.sota2.com/research/sota/independence-testing-on-circle-distribution-test.md>): Independence testing; Circle distribution (test); Rejection Rate: 100.

- [Independence testing on Diamond distribution (test)](<https://www.sota2.com/research/sota/independence-testing-on-diamond-distribution-test.md>): Independence testing; Diamond distribution (test); Rejection Rate: 100.

- [Independence testing on Parabola distribution (test)](<https://www.sota2.com/research/sota/independence-testing-on-parabola-distribution-test.md>): Independence testing; Parabola distribution (test); Rejection Rate: 1.

- [Independence testing on TwoParabola distribution (test)](<https://www.sota2.com/research/sota/independence-testing-on-twoparabola-distribution-test.md>): Independence testing; TwoParabola distribution (test); Rejection Rate: 100.

- [Independence testing on Variance distribution (test)](<https://www.sota2.com/research/sota/independence-testing-on-variance-distribution-test.md>): Independence testing; Variance distribution (test); Rejection Rate: 100.

- [Independence testing on Log distribution (test)](<https://www.sota2.com/research/sota/independence-testing-on-log-distribution-test.md>): Independence testing; Log distribution (test); Rejection Rate: 100.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2504.21419>)

[PDF](<https://arxiv.org/pdf/2504.21419.pdf>)
