# Investigating Batch Inference in a Sequential Monte Carlo Framework for Neural Networks

Source: [Investigating Batch Inference in a Sequential Monte Carlo Framework for Neural Networks](<https://www.sota2.com/research/paper/697c3b73a8b01e76cc8da783>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-01-31T05:00:14.704Z

Authors: Andrew Millard, Joshua Murphy, Peter Green, Simon Maskell

Published: 2026-01-29T16:59:31.000Z

## Abstract

Bayesian inference allows us to define a posterior distribution over the weights of a generic neural network (NN). Exact posteriors are usually intractable, in which case approximations can be employed. One such approximation - variational inference - is computationally efficient when using mini-batch stochastic gradient descent as subsets of the data are used for likelihood and gradient evaluations, though the approach relies on the selection of a variational distribution which sufficiently matches the form of the posterior. Particle-based methods such as Markov chain Monte Carlo and Sequential Monte Carlo (SMC) do not assume a parametric family for the posterior by typically require higher computational cost. These sampling methods typically use the full-batch of data for likelihood and gradient evaluations, which contributes to this computational expense. We explore several methods of gradually introducing more mini-batches of data (data annealing) into likelihood and gradient evaluations of an SMC sampler. We find that we can achieve up to $6\\times$ faster training with minimal loss in accuracy on benchmark image classification problems using NNs.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2601.21983>)

[PDF](<https://arxiv.org/pdf/2601.21983.pdf>)
