# Generating Efficient DNN-Ensembles with Evolutionary Computation

Source: [Generating Efficient DNN-Ensembles with Evolutionary Computation](<https://www.sota2.com/research/paper/68fa69e91e209131cea24d7b>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T23:11:37.721Z

Authors: Marc Ortiz, Florian Scheidegger, Marc Casas, Cristiano Malossi, Eduard Ayguad\\'e

Published: 2020-09-18T09:14:56.000Z

## Abstract

In this work, we leverage ensemble learning as a tool for the creation of faster, smaller, and more accurate deep learning models. We demonstrate that we can jointly optimize for accuracy, inference time, and the number of parameters by combining DNN classifiers. To achieve this, we combine multiple ensemble strategies: bagging, boosting, and an ordered chain of classifiers. To reduce the number of DNN ensemble evaluations during the search, we propose EARN, an evolutionary approach that optimizes the ensemble according to three objectives regarding the constraints specified by the user. We run EARN on 10 image classification datasets with an initial pool of 32 state-of-the-art DCNN on both CPU and GPU platforms, and we generate models with speedups up to $7.60\\times$, reductions of parameters by $10\\times$, or increases in accuracy up to $6.01\\%$ regarding the best DNN in the pool. In addition, our method generates models that are $5.6\\times$ faster than the state-of-the-art methods for automatic model generation.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2009.08698>)

[PDF](<https://arxiv.org/pdf/2009.08698.pdf>)
