A modular hierarchical array camera

Xiaoyun Yuan, Mengqi Ji, Jiamin Wu, David J. Brady, Qionghai Dai, Lu Fang

Research output: Contribution to journalArticlepeer-review

33 Scopus citations

Abstract

Array cameras removed the optical limitations of a single camera and paved the way for high-performance imaging via the combination of micro-cameras and computation to fuse multiple aperture images. However, existing solutions use dense arrays of cameras that require laborious calibration and lack flexibility and practicality. Inspired by the cognition function principle of the human brain, we develop an unstructured array camera system that adopts a hierarchical modular design with multiscale hybrid cameras composing different modules. Intelligent computations are designed to collaboratively operate along both intra- and intermodule pathways. This system can adaptively allocate imagery resources to dramatically reduce the hardware cost and possesses unprecedented flexibility, robustness, and versatility. Large scenes of real-world data were acquired to perform human-centric studies for the assessment of human behaviours at the individual level and crowd behaviours at the population level requiring high-resolution long-term monitoring of dynamic wide-area scenes.

Original languageEnglish (US)
Article number37
JournalLight: Science and Applications
Volume10
Issue number1
DOIs
StatePublished - Dec 2021

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Atomic and Molecular Physics, and Optics

Fingerprint

Dive into the research topics of 'A modular hierarchical array camera'. Together they form a unique fingerprint.

Cite this