Time-Sensitive and Distance-Tolerant Deep Learning-Based Vehicle Detection Using High-Resolution Radar Bird's-Eye-View Images

Ruxin Zheng, Shunqiao Sun, Hongshan Liu, Teresa Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations


Advanceddriver assistance systems (ADASs) and autonomous vehicles rely on differenttypes of sensors, such as cameras, radar, ultrasonic, and LiDAR to sense thesurrounding environment. Compared with the other types of sensors,millimeter-wave automotive radar has advantages in terms of low hardware costand reliable object detection under poor weather conditions, such as snow,rain, or fog, and doesn't suffer from light condition variations, such asdarkness. High-resolution radar bird's-eye-view (BEV) obtained from radarrange-azimuth spectra through a polar-to-Cartesian coordinate transformcontains targets' geometric information that can be learned by deep neuralnetworks for object detection. Compared to radar point clouds, there is noinformation loss in radar BEV. Unlike RGB images, radar BEVs are single-channelgrayscale images with unique characteristics such as inconsistent resolutionand SNR. Therefore, directly implementing an image-based object detectionnetwork is not an optimal solution for object detection using radar BEV. Wepropose a Temporal-fusion, Distance tolerant single stage object detectionNetwork, termed as, TDRadarNet, to robustly detect vehicles up to 100 metersunder various driving scenarios. DRadarNet leverages historical radar frames toexploit temporal features and separates far and near fields to addressinconsistent resolution in radar frames. With qualitative and quantitativeresults, we show that TDRadarNet achieves 68.9% in precision and 66.8% inrecall, and 67.8% in F1-score, which outperforms the state-of-the-artimage-based object detection networks by 10.6%, 17.1%, and 14.1%.

Original languageEnglish (US)
Title of host publicationRadarConf23 - 2023 IEEE Radar Conference, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665436694
StatePublished - 2023
Event2023 IEEE Radar Conference, RadarConf23 - San Antonia, United States
Duration: May 1 2023May 5 2023

Publication series

NameProceedings of the IEEE Radar Conference


Conference2023 IEEE Radar Conference, RadarConf23
Country/TerritoryUnited States
CitySan Antonia


  • Automotive radar
  • autonomous vehicles
  • deep neural network
  • machine learning

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Signal Processing
  • Instrumentation


Dive into the research topics of 'Time-Sensitive and Distance-Tolerant Deep Learning-Based Vehicle Detection Using High-Resolution Radar Bird's-Eye-View Images'. Together they form a unique fingerprint.

Cite this