3D Radar and Camera Co-Calibration: A flexible and Accurate Method for Target-based Extrinsic Calibration

Lei Cheng, Arindam Sengupta, Siyang Cao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Advances in autonomous driving are inseparable from sensor fusion. Heterogeneous sensors are widely used for sensor fusion due to their complementary properties, with radar and camera being the most equipped sensors. Intrinsic and extrinsic calibration are essential steps in sensor fusion. The extrinsic calibration, independent of the sensor's own parameters, and performed after the sensors are installed, greatly determines the accuracy of sensor fusion. Many target-based methods require cumbersome operating procedures and well-designed experimental conditions, making them extremely challenging. To this end, we propose a flexible, easy-to-reproduce and accurate method for extrinsic calibration of 3D radar and camera. The proposed method does not require a specially designed calibration environment, and instead places a single corner reflector (CR) on the ground to iteratively collect radar and camera data simultaneously using Robot Operating System (ROS), and obtain radar-camera point correspondences based on their timestamps, and then use these point correspondences as input to solve the perspective-n-point (PnP) problem, and finally get the extrinsic calibration matrix. Also, RANSAC is used for robustness and the Levenberg-Marquardt (LM) nonlinear optimization algorithm is used for accuracy. Multiple controlled environment experiments as well as real-world experiments demonstrate the efficiency and accuracy (AED error is 15.31 pixels and Acc up to 89%) of the proposed method.

Original languageEnglish (US)
Title of host publicationRadarConf23 - 2023 IEEE Radar Conference, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665436694
DOIs
StatePublished - 2023
Event2023 IEEE Radar Conference, RadarConf23 - San Antonia, United States
Duration: May 1 2023May 5 2023

Publication series

NameProceedings of the IEEE Radar Conference
Volume2023-May

Conference

Conference2023 IEEE Radar Conference, RadarConf23
Country/TerritoryUnited States
CitySan Antonia
Period5/1/235/5/23

Keywords

  • 3D Radar
  • Extrinsic Calibration
  • Radar-Camera Calibration
  • Sensor Fusion

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Signal Processing
  • Instrumentation

Fingerprint

Dive into the research topics of '3D Radar and Camera Co-Calibration: A flexible and Accurate Method for Target-based Extrinsic Calibration'. Together they form a unique fingerprint.

Cite this