# Effective Approaches to Batch Parallelization for Dynamic Neural Network Architectures

Source: [Effective Approaches to Batch Parallelization for Dynamic Neural Network Architectures](<https://www.sota2.com/research/paper/68fa63831e209131ce9ff1a2>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T20:42:16.909Z

Authors: Joseph Suarez, Clare Zhu

Published: 2017-07-08T06:04:31.000Z

## Abstract

We present a simple dynamic batching approach applicable to a large class of dynamic architectures that consistently yields speedups of over 10x. We provide performance bounds when the architecture is not known a priori and a stronger bound in the special case where the architecture is a predetermined balanced tree. We evaluate our approach on Johnson et al.'s recent visual question answering (VQA) result of his CLEVR dataset by Inferring and Executing Programs (IEP). We also evaluate on sparsely gated mixture of experts layers and achieve speedups of up to 1000x over the naive implementation.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1707.02402>)

[PDF](<https://arxiv.org/pdf/1707.02402.pdf>)
