# A Complementarity Analysis of the COCO Benchmark Problems and Artificially Generated Problems

Source: [A Complementarity Analysis of the COCO Benchmark Problems and Artificially Generated Problems](<https://www.sota2.com/research/paper/68fa69d61e209131cea247dc>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-28T13:56:47.629Z

Authors: Urban \\v{S}kvorc, Tome Eftimov, Peter Koro\\v{s}ec

Published: 2021-04-27T09:18:43.000Z

## Abstract

When designing a benchmark problem set, it is important to create a set of benchmark problems that are a good generalization of the set of all possible problems. One possible way of easing this difficult task is by using artificially generated problems. In this paper, one such single-objective continuous problem generation approach is analyzed and compared with the COCO benchmark problem set, a well know problem set for benchmarking numerical optimization algorithms. Using Exploratory Landscape Analysis and Singular Value Decomposition, we show that such representations allow us to further explore the relations between the problems by applying visualization and correlation analysis techniques, with the goal of decreasing the bias in benchmark problem assessment.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2104.13060>)

[PDF](<https://arxiv.org/pdf/2104.13060.pdf>)