# Heterogeneous Variational Inference for Markov Degradation Hazard Models: Discretized Mixture with Interpretable Clusters

Source: [Heterogeneous Variational Inference for Markov Degradation Hazard Models: Discretized Mixture with Interpretable Clusters](<https://www.sota2.com/research/paper/69f1906855a3c32af89fb903>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-30T05:00:04.704Z

Authors: Takato Yasuno

Published: 2026-04-27T14:02:43.000Z

## Abstract

Bayesian finite mixture models can identify discrete risk clusters (low-risk vs. high-risk equipment), but face three critical bottlenecks: (1) insufficient degradation signals from coarse state discretization, (2) unstable cluster identification when data inherently supports fewer clusters than explored, and (3) computational infeasibility of Markov Chain Monte Carlo (MCMC) methods for production deployment (7+ hours per model). We propose a practical framework combining (1) 8-state global percentile discretization that amplifies degradation events, (2) 30-dimensional feature engineering integrating statistical trends (22 features), continuous health indicators, and text embeddings (PCA-compressed to 3 dimensions), (3) interpretable model selection rules enforcing minimum cluster share and separation alongside WAIC, and (4) Automatic Differentiation Variational Inference (ADVI) with full-rank covariance for stable, fast estimation. Applied to 280 industrial pump equipment with 104,703 inspection records, we demonstrate: (1) Random effect models (baseline) show ADVI and NUTS produce nearly identical estimates with 15$\\times$ speedup, validating ADVI accuracy. (2) Finite mixture models identify optimal number of clusters with interpretability constraints. (3) NUTS exhibits severe convergence issues and label switching, while ADVI provides stable results in 84$\\times$ less time. We contributed that (1) First demonstration that fine-grained state discretization (8-state) is essential for mixture model stability in survival analysis.(2) Comprehensive feature engineering strategy combining statistical, continuous, and semantic signals. (3) Practical interpretability rules preventing overfitting in automated model selection. (4) Empirical evidence that ADVI outperforms NUTS for finite mixture models in terms of convergence, stability, and computational efficiency.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Finite Mixture Modeling on Pump Degradation C=2 (mix1 vs mix2 comparison)](<https://www.sota2.com/research/sota/finite-mixture-modeling-on-pump-degradation-c-2-mix1-vs-mix2-comparison.md>): Finite Mixture Modeling; Pump Degradation C=2 (mix1 vs mix2 comparison); Execution Time: 5.

- [Probabilistic Mixture Modeling on Industrial pump equipment inspection data 1991-2025](<https://www.sota2.com/research/sota/probabilistic-mixture-modeling-on-industrial-pump-equipment-inspection-data-1991-2025.md>): Probabilistic Mixture Modeling; Industrial pump equipment inspection data 1991-2025; Execution Time: 5.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2604.24818>)

[PDF](<https://arxiv.org/pdf/2604.24818.pdf>)
