BMISP: Bidirectional mapping of image signal processing pipeline

Yahui Tang, Kan Chang, Mengyuan Huang, Baoxin Li

Research output: Contribution to journalArticlepeer-review

2 Scopus citations


After being processed by the image signal processing (ISP) pipeline in digital cameras, the sRGB images are nonlinear, and thus are not suitable for the computer vision tasks which work best in a linear color space. Therefore, mapping nonlinear sRGB images back to a linear color space is a highly valuable task. To achieve an accurate mapping, this paper proposes a framework based on convolutional neural networks, which models the ISP pipeline in both reverse and forward directions. In particular, for the reverse mapping, a U-net structure is applied to extract features from a given sRGB image, and the extracted features are utilized to estimate the linear and nonlinear transformations in the ISP pipeline. For the forward mapping, the original sRGB image is used as a guidance to embed the camera-style information. To incorporate the encoded prior knowledge, affine transformations are employed to modulate the features. Experiments demonstrate that the proposed framework is able to achieve the state-of-the-art performance.

Original languageEnglish (US)
Article number109135
JournalSignal Processing
StatePublished - Nov 2023


  • CIE XYZ space
  • Convolutional neural networks
  • Image enhancement
  • Image signal processing pipeline

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering


Dive into the research topics of 'BMISP: Bidirectional mapping of image signal processing pipeline'. Together they form a unique fingerprint.

Cite this