Back to articles
Volume: 29 | Article ID: art00016
Edge-aware Light-Field Flow for Depth Estimation and Occlusion Detection
  DOI :  10.2352/ISSN.2470-1173.2017.17.COIMG-431  Published OnlineJanuary 2017

Light-field cameras capture 4-dimensional spatio-angular information of the light field. They provide more helpful multiple viewpoints or sub-apertures for visual analysis and visual understanding than traditional cameras. Optical flow is a common method to get scene structure cues from two images, however, subpixel displacements and occlusions are two inevitable challenges in the optical flow estimation from light-field sub-apertures. In this paper, we develop a light-field flow model, and propose an edge-aware light-field flow estimation framework for joint depth estimation and occlusion detection. It consists of three steps: i) An optical flow volume with sub-pixel accuracy is extracted from sub-apertures by edge-preserving interpolation. Then occlusion regions are detected through consistency checking. ii) Robust light-field flow and depth estimation are initialized by a winner-take-all strategy and a weighted voting mechanism. iii) Final depth map is refined by a weighted median filter based on guided filter. Experimental results demonstrate the effectiveness and robustness of our method.

Subject Areas :
Views 36
Downloads 0
 articleview.views 36
 articleview.downloads 0
  Cite this article 

Wenhui Zhou, Andrew Lumsdaine, Lili Lin, Wei Zhang, Rong Wang, "Edge-aware Light-Field Flow for Depth Estimation and Occlusion Detectionin Proc. IS&T Int’l. Symp. on Electronic Imaging: Computational Imaging XV,  2017,  pp 94 - 99,

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2017
Electronic Imaging
Society for Imaging Science and Technology