# Raw or Cooked? Object Detection on RAW Images

Source: [Raw or Cooked? Object Detection on RAW Images](<https://www.sota2.com/research/paper/68fa72d31e209131cea58bcf>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T02:35:49.064Z

Authors: William Ljungbergh, Joakim Johnander, Christoffer Petersson, Michael Felsberg

Published: 2023-01-21T15:42:53.000Z

## Abstract

Images fed to a deep neural network have in general undergone several handcrafted image signal processing (ISP) operations, all of which have been optimized to produce visually pleasing images. In this work, we investigate the hypothesis that the intermediate representation of visually pleasing images is sub-optimal for downstream computer vision tasks compared to the RAW image representation. We suggest that the operations of the ISP instead should be optimized towards the end task, by learning the parameters of the operations jointly during training. We extend previous works on this topic and propose a new learnable operation that enables an object detector to achieve superior performance when compared to both previous works and traditional RGB images. In experiments on the open PASCALRAW dataset, we empirically confirm our hypothesis.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [RGB to RAW reconstruction on FIVEK Nikon (test)](<https://www.sota2.com/research/sota/rgb-to-raw-reconstruction-on-fivek-nikon-test.md>): RGB to RAW reconstruction; FIVEK Nikon (test); PSNR: 27.88.

- [RGB to RAW reconstruction on FIVEK Canon (test)](<https://www.sota2.com/research/sota/rgb-to-raw-reconstruction-on-fivek-canon-test.md>): RGB to RAW reconstruction; FIVEK Canon (test); PSNR: 26.85.

- [RGB to RAW reconstruction on NOD Nikon (test)](<https://www.sota2.com/research/sota/rgb-to-raw-reconstruction-on-nod-nikon-test.md>): RGB to RAW reconstruction; NOD Nikon (test); PSNR: 37.14.

- [RGB to RAW reconstruction on NOD Sony (test)](<https://www.sota2.com/research/sota/rgb-to-raw-reconstruction-on-nod-sony-test.md>): RGB to RAW reconstruction; NOD Sony (test); PSNR: 35.69.

- [RGB to RAW reconstruction on PASCALRAW (test)](<https://www.sota2.com/research/sota/rgb-to-raw-reconstruction-on-pascalraw-test.md>): RGB to RAW reconstruction; PASCALRAW (test); PSNR: 30.45.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2301.08965>)

[PDF](<https://arxiv.org/pdf/2301.08965.pdf>)
