Back to articles
Volume: 21 | Article ID: art00019
RGBZ Image Restoration by Patch Clone
  DOI :  10.2352/CIC.2013.21.1.art00019  Published OnlineJanuary 2013

The RGBZ sensor is a novel imaging sensor that captures both color and depth images simultaneously in a single chip, with a specially designed color-filter-array (CFA), in which some of the RGB color pixels are replaced by “Z” pixels that capture depth information but no color information. As a result, RGB color images produced by this pixel array appear degraded, with missing RGB values or “holes” at locations occupied by the Z pixels. To fill in these “holes”, and thus restore resolution and appearance of color images, we propose a Patch-Clone method that exploits redundant texture information in the scene. Derived from the non-local approaches, our method consists of two steps: 1) a matching step to identify the candidate patch that contains the most useful information to reconstruct the color pixels missing at a particular hole; 2) a cloning step to copy the content from the candidate to fill in the hole. When higher order pixel content is copied, pixel continuity between the restored and original pixels can be enforced. The result of the proposed method is full resolution Bayer images, to which existing common demosaic algorithms can be applied. Tests show that the proposed method provides better reconstruction result in term of distortion error as well as visual appearance.

Subject Areas :
Views 9
Downloads 1
 articleview.views 9
 articleview.downloads 1
  Cite this article 

Lilong Shi, Ilia Ovsiannikov, Dong-Ki Min, Wonjoo Kim, Yibing Michelle Wang, Grzegorz Waligorski, Hongyu Wang, Yoondong Park, Chilhee Chung, "RGBZ Image Restoration by Patch Clonein Proc. IS&T 21st Color and Imaging Conf.,  2013,  pp 108 - 113,

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2013
Color and Imaging Conference
color imaging conf
Society of Imaging Science and Technology
7003 Kilworth Lane, Springfield, VA 22151, USA