Back to articles
Articles
Volume: 26 | Article ID: art00032
Image
Efficient Multispectral Facial Capture With Monochrome Cameras
  DOI :  10.2352/ISSN.2169-2629.2018.26.187  Published OnlineNovember 2018
Abstract

We propose a variant to polarized gradient illumination facial scanning which uses monochrome instead of color cameras to achieve more efficient and higher-resolution results. In typical polarized gradient facial scanning, sub-millimeter geometric detail is acquired by photographing the subject in eight or more polarized spherical gradient lighting conditions made with white LEDs, and RGB cameras are used to acquire color texture maps of the subject's appearance. In our approach, we replace the color cameras and white LEDs with monochrome cameras and multispectral, colored LEDs, noting that color images can be formed from successive monochrome images recorded under different illumination colors. While a naive extension of the scanning process to this setup would require multiplying the number of images by number of color channels, we show that the suiface detail maps can be estimated directly from monochrome imagery, so that only an additional n photographs are required, where n is the number of added spectral channels. We also introduce a new multispectral optical flow approach to align images across spectral channels in the presence of slight subject motion. Lastly, for the case where a capture system's white light sources are polarized and its multispectral colored LEDs are not, we introduce the technique of multispectral polarization promotion, where we estimate the cross- and parallel-polarized monochrome images for each spectral channel from their corresponding images under a full sphere of even, unpolarized illumination. We demonstrate that this technique allows us to efficiently acquire a full color (or even multispectral) facial scan using monochrome cameras, unpolarized multispectral colored LEDs, and polarized white LEDs.

Subject Areas :
Views 8
Downloads 0
 articleview.views 8
 articleview.downloads 0
  Cite this article 

Chloe LeGendre, Kalle Bladin, Bipin Kishore, Xinglei Ren, Xueming Yu, Paul Debevec, "Efficient Multispectral Facial Capture With Monochrome Camerasin Proc. IS&T 26th Color and Imaging Conf.,  2018,  pp 187 - 202,  https://doi.org/10.2352/ISSN.2169-2629.2018.26.187

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2018
72010350
Color and Imaging Conference
color imaging conf
2166-9635
Society for Imaging Science and Technology