Back to articles
Volume: 29 | Article ID: art00018
Camera-to-Model Back-Raycasting for Extraction of RGB-D Images from Pointclouds
  DOI :  10.2352/ISSN.2470-1173.2017.13.IPAS-210  Published OnlineJanuary 2017

Conventional raycasting methods extract 2D-images from pointclouds in two main steps. The pointcloud is voxelized and then, rays are casted from a virtual-camera center towards the model. The value for each pixel in the resulting image is calculated based on the closest non-empty voxel intersected with the corresponding ray. Both voxelizing and such raycasting limit the quality (resolution) of the extracted image and impose high memory demands. In this paper, we propose an alternative backraycasting method, where rays are casted from the model towards the virtual-camera center and intersecting an image plane. This does not require any voxel grid to be generated. Moreover, this method allows to obtain images with any required resolution with all the points involved. Besides this, a neighbours-consistency technique is introduced to enhance the resulting image quality. The proposed method has been evaluated based on several criteria and for various resolutions. Evaluation results show that the proposed method compared to the conventional approach executes upto 49 times faster and improves PSNR and SSIM metrics for the resulting images by 26% and 12%, respectively. This improvement is beneficial for such domains as feature matching, edge detection, OCR and calibration. To enable researchers generating the same results and extend this work, the dataset and implementation codes are publicly available.

Subject Areas :
Views 102
Downloads 4
 articleview.views 102
 articleview.downloads 4
  Cite this article 

Hani Javan Hemmat, Egor Bondarev, Peter H.N. de With, "Camera-to-Model Back-Raycasting for Extraction of RGB-D Images from Pointcloudsin Proc. IS&T Int’l. Symp. on Electronic Imaging: Image Processing: Algorithms and Systems XV,  2017,  pp 117 - 124,

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2017
Electronic Imaging
Society for Imaging Science and Technology