Back to articles
Articles
Volume: 28 | Article ID: art00030
Image
Towards Perceptually Coherent Depth Maps in 2D-to-3D Conversion
  DOI :  10.2352/ISSN.2470-1173.2016.5.SDA-433  Published OnlineFebruary 2016
Abstract

We propose a semi-automatic 2D-to-3D conversion algorithm that is embedded in an efficient optimization framework, i.e., cost volume filtering, which assigns pixels to depth values initialized by user-given scribbles. The proposed algorithm is capable of capturing depth changes of objects that move towards or farther away from the camera. We achieve this by determining a rough depth order between objects in each frame, according to the motion observed in the video, and incorporate this depth order into the depth interpolation process. In contrast to previous publications, our algorithm focuses on avoiding conflicts between the generated depth maps and monocular depth cues that are present in the video, i.e., motion-caused occlusions, and thus takes a step towards the generation of perceptually coherent depth maps. We demonstrate the capabilities of our proposed algorithm on synthetic and recorded video data and by comparison with depth ground truth. Experimental evaluations show that we obtain temporally and perceptually coherent 2D-to-3D conversions in which temporal and spatial edges coincide with edges in the corresponding input video. We achieve competitive 2D-to-3D conversion results. Our proposed depth interpolation can clearly improve the conversion results for videos that contain objects which exhibit motion in depth, compared to commonly performed naive depth interpolation techniques.

Subject Areas :
Views 9
Downloads 2
 articleview.views 9
 articleview.downloads 2
  Cite this article 

Nicole Brosch, Tanja Schausberger, Margrit Gelautz, "Towards Perceptually Coherent Depth Maps in 2D-to-3D Conversionin Proc. IS&T Int’l. Symp. on Electronic Imaging: Stereoscopic Displays and Applications XXVII,  2016,  https://doi.org/10.2352/ISSN.2470-1173.2016.5.SDA-433

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2016
72010604
Electronic Imaging
2470-1173
Society for Imaging Science and Technology
7003 Kilworth Lane, Springfield, VA 22151 USA