Back to articles
Proceedings Paper
Volume: 37 | Article ID: AVM-113
Image
Minimizing Occlusion Effect on Multi-view Camera Perception in BEV with Multi-sensor Fusion
  DOI :  10.2352/EI.2025.37.15.AVM-113  Published OnlineFebruary 2025
Abstract
Abstract

Autonomous driving technology is rapidly evolving, offering the potential for safer and more efficient transportation. However, the performance of these systems can be significantly compromised by the occlusion on sensors due to environmental factors like dirt, dust, rain, and fog. These occlusions severely affect vision-based tasks such as object detection, vehicle segmentation, and lane recognition. In this paper, we investigate the impact of various kinds of occlusions on camera sensor by projecting their effects from multi-view camera images of the nuScenes dataset into the Bird’s-Eye View (BEV) domain. This approach allows us to analyze how occlusions spatially distribute and influence vehicle segmentation accuracy within the BEV domain. Despite significant advances in sensor technology and multi-sensor fusion, a gap remains in the existing literature regarding the specific effects of camera occlusions on BEV-based perception systems. To address this gap, we use a multi-sensor fusion technique that integrates LiDAR and radar sensor data to mitigate the performance degradation caused by occluded cameras. Our findings demonstrate that this approach significantly enhances the accuracy and robustness of vehicle segmentation tasks, leading to more reliable autonomous driving systems. https: // youtu. be/ OmX2NEeOzAE

Subject Areas :
Views 25
Downloads 6
 articleview.views 25
 articleview.downloads 6
  Cite this article 

Sanjay Kumar, Hiep Truong, Sushil Sharma, Ganesh Sistu, Tony Scanlan, Eoin Grua, Ciarán Eising, "Minimizing Occlusion Effect on Multi-view Camera Perception in BEV with Multi-sensor Fusionin Electronic Imaging,  2025,  pp 113-1 - 113-6,  https://doi.org/10.2352/EI.2025.37.15.AVM-113

 Copy citation
  Copyright statement 
Copyright © 2025 Society for Imaging Science and Technology 2025
ei
Electronic Imaging
2470-1173
2470-1173
Society for Imaging Science and Technology
IS&T 7003 Kilworth Lane, Springfield, VA 22151 USA