Back to articles
Article
Volume: 35 | Article ID: AVM-118
Image
Using simulation to quantify the performance of automotive perception systems
  DOI :  10.2352/EI.2023.35.16.AVM-118  Published OnlineJanuary 2023
Abstract
Abstract

The design and evaluation of complex systems can benefit from a software simulation - sometimes called a digital twin. The simulation can be used to characterize system performance or to test its performance under conditions that are difficult to measure (e.g., nighttime for automotive perception systems). We describe the image system simulation software tools that we use to evaluate the performance of image systems for object (automobile) detection. We describe experiments with 13 different cameras with a variety of optics and pixel sizes. To measure the impact of camera spatial resolution, we designed a collection of driving scenes that had cars at many different distances. We quantified system performance by measuring average precision and we report a trend relating system resolution and object detection performance. We also quantified the large performance degradation under nighttime conditions, compared to daytime, for all cameras and a COCO pre-trained network.

Subject Areas :
Views 225
Downloads 85
 articleview.views 225
 articleview.downloads 85
  Cite this article 

Zhenyi Liu, Devesh Shah, Alireza Rahimpour, Devesh Upadhyay, Joyce Farrell, Brian Wandell, "Using simulation to quantify the performance of automotive perception systemsin Electronic Imaging,  2023,  pp 118-1 - 118-8,  https://doi.org/10.2352/EI.2023.35.16.AVM-118

 Copy citation
  Copyright statement 
Copyright © 2023, Society for Imaging Science and Technology 2023
ei
Electronic Imaging
2470-1173
2470-1173
Society for Imaging Science and Technology
IS&T 7003 Kilworth Lane, Springfield, VA 22151 USA