# Sparsifying Priors for Bayesian Uncertainty Quantification in Model Discovery

Source: [Sparsifying Priors for Bayesian Uncertainty Quantification in Model Discovery](<https://www.sota2.com/research/paper/68fa58391e209131ce9ac6a7>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T15:12:38.356Z

Authors: Seth M. Hirsh, David A. Barajas-Solano, J. Nathan Kutz

Published: 2021-07-05T16:05:52.000Z

## Abstract

We propose a probabilistic model discovery method for identifying ordinary differential equations (ODEs) governing the dynamics of observed multivariate data. Our method is based on the sparse identification of nonlinear dynamics (SINDy) framework, in which target ODE models are expressed as a sparse linear combinations of pre-specified candidate functions. Promoting parsimony through sparsity in SINDy leads to interpretable models that generalize to unknown data. Instead of targeting point estimates of the SINDy (linear combination) coefficients, in this work we estimate these coefficients via sparse Bayesian inference. The resulting method, uncertainty quantification SINDy (UQ-SINDy), quantifies not only the uncertainty in the values of the SINDy coefficients due to observation errors and limited data, but also the probability of inclusion of each candidate function in the linear combination. UQ-SINDy promotes robustness against observation noise and limited data, interpretability (in terms of model selection and inclusion probabilities), and generalization capacity for out-of-sample forecast. Sparse inference for UQ-SINDy employs Markov Chain Monte Carlo, and we explore two sparsifying priors: the spike-and-slab prior, and the regularized horseshoe prior. We apply UQ-SINDy to synthetic nonlinear data sets from a Lotka-Volterra model and a nonlinear oscillator, and to a real-world data set of lynx and hare populations. We find that UQ-SINDy is able to discover accurate and meaningful models even in the presence of noise and limited data samples.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [PDE Discovery on Burgers’ equation (0.2% Noise)](<https://www.sota2.com/research/sota/pde-discovery-on-burgers-equation-0-2-percent-noise.md>): PDE Discovery; Burgers’ equation (0.2% Noise); MSE: 0.0000349.

- [Symbolic Regression on Kepler benchmark](<https://www.sota2.com/research/sota/symbolic-regression-on-kepler-benchmark.md>): Symbolic Regression; Kepler benchmark; R^-2 Rate: 8.

- [System Identification on Lorenz System 5% noise](<https://www.sota2.com/research/sota/system-identification-on-lorenz-system-5-percent-noise.md>): System Identification; Lorenz System 5% noise; MSE: 6623.

- [System Identification on Lotka-Volterra System 5% noise](<https://www.sota2.com/research/sota/system-identification-on-lotka-volterra-system-5-percent-noise.md>): System Identification; Lotka-Volterra System 5% noise; MSE: 44.7.

- [Equation Discovery on Convection-Diffusion Equation 0.1% noise](<https://www.sota2.com/research/sota/equation-discovery-on-convection-diffusion-equation-0-1-percent-noise.md>): Equation Discovery; Convection-Diffusion Equation 0.1% noise; MSE (True Data): 0.00002053.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2107.02107>)

[PDF](<https://arxiv.org/pdf/2107.02107.pdf>)
