Back to articles
Volume: 30 | Article ID: art00002
Optimizing Image Acquisition Systems for Autonomous Driving
  DOI :  10.2352/ISSN.2470-1173.2018.05.PMII-161  Published OnlineJanuary 2018

Task requirements for image acquisition systems vary substantially between applications: requirements for consumer photography may be irrelevant - or may even interfere - with requirements for automotive, medical and other applications. The remarkable capabilities of the imaging industry to create lens and sensor designs for specific applications has been demonstrated in the mobile computing market. We might expect that the industry can further innovate if we specify the requirements for other markets. This paper explains an approach to developing image system designs that meet the task requirements for autonomous vehicle applications. It is impractical to build a large number of image acquisition systems and evaluate each of them with real driving data; therefore, we assembled a simulation environment to provide guidance at an early stage. The open-source and freely available software (isetcam, iset3d, and isetauto) uses ray tracing to compute quantitatively how scene radiance propagates through a multi-element lens to form the sensor irradiance. The software then transforms the irradiance into the sensor pixel responses, accounting for a large number of sensor parameters. This enables the user to apply different types of image processing pipelines to generate images that are used to train and test convolutional networks used in autonomous driving. We use the simulation environment to assess performance for different cameras and networks.

Subject Areas :
Views 49
Downloads 12
 articleview.views 49
 articleview.downloads 12
  Cite this article 

Henryk Blasinski, Joyce Farrell, Trisha Lian, Zhenyi Liu, Brian Wandell, "Optimizing Image Acquisition Systems for Autonomous Drivingin Proc. IS&T Int’l. Symp. on Electronic Imaging: Photography, Mobile, and Immersive Imaging,  2018,  pp 161-1 - 161-7,

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2018
Electronic Imaging
Society for Imaging Science and Technology