Back to articles
Article
Volume: 35 | Article ID: AVM-122
Image
How much depth information can radar contribute to a depth estimation model?
  DOI :  10.2352/EI.2023.35.16.AVM-122  Published OnlineJanuary 2023
Abstract
Abstract

Recently, many works have proposed to fuse radar data as an additional perceptual signal into monocular depth estimation models because radar data is robust against various light and weather conditions. Although positive results were reported in prior works, it is still hard to tell how much depth information radar can contribute to a depth estimation model. In this paper, we propose radar inference and supervision experiments to investigate the intrinsic depth capability of radar data using state-of-the-art depth estimation models on the nuScenes dataset. In the inference experiment, the model predicts depth by taking only radar as input to demonstrate the inference capability of radar data. In the supervision experiment, a monocular depth estimation model is trained under radar supervision to show the intrinsic depth information that radar can contribute. Our experiments demonstrate that the model with only sparse radar input can detect the shape of surroundings to a certain extent in the predicted depth. Furthermore, the monocular depth estimation model supervised by preprocessed radar achieves a good performance compared to the baseline model trained with sparse lidar supervision.

Subject Areas :
Views 102
Downloads 38
 articleview.views 102
 articleview.downloads 38
  Cite this article 

Chen-Chou Lo, Patrick Vandewalle, "How much depth information can radar contribute to a depth estimation model?in Electronic Imaging,  2023,  pp 122-1 - 122-7,  https://doi.org/10.2352/EI.2023.35.16.AVM-122

 Copy citation
  Copyright statement 
Copyright © 2023, Society for Imaging Science and Technology 2023
ei
Electronic Imaging
2470-1173
2470-1173
Society for Imaging Science and Technology
IS&T 7003 Kilworth Lane, Springfield, VA 22151 USA