Back to articles
Regular Articles
Volume: 61 | Article ID: jist0277
Image
Decoupling of Real and Digital Content in Projection-based Augmented Reality Systems Using Time Multiplexed Image Capture
  DOI :  10.2352/J.ImagingSci.Technol.2017.61.1.010406  Published OnlineJanuary 2017
Abstract
Abstract

Projection-based augmented reality systems overlay digital information directly on real objects, while at the same time use cameras to capture the scene information. A common problem with such systems is that cameras see the projected image besides the real objects to some degree. This crosstalk reduces the object detection and digital content registration abilities. The authors propose a novel time sharing-based technique that facilitates the real and digital content decoupling in real time without crosstalk. The proposed technique is based on time sequential operation between a MEMS scanner-based mobile projector and rolling shutter image sensor. A MEMS mirror- based projector scans light beam in raster pattern pixel by pixel and completes full frame projection over a refresh period, while a rolling shutter image sensor sequentially collects scene light row by row. In the proposed technique, the image sensor is synchronized with scanning MEMS mirror and precisely follows the display scanner with a half-period lag to make the displayed content completely invisible for camera. An experimental setup consisting of laser pico projector, an image sensor, and a delay and amplifier circuit is developed. The performance of proposed technique is evaluated by measuring the crosstalk in captured content and sensor exposure limit. The results show 0% crosstalk in captured content up to 8 ms sensor exposure. High capture frame rate (up to 45 fps) is achieved by cyclically triggering a 3.2 MP, 60 fps CMOS sensor and using a 60 Hz pico projector.

Subject Areas :
Views 93
Downloads 1
 articleview.views 93
 articleview.downloads 1
  Cite this article 

Shoaib R. Soomro, Erdem Ulusoy, Hakan Urey, "Decoupling of Real and Digital Content in Projection-based Augmented Reality Systems Using Time Multiplexed Image Capturein Journal of Imaging Science and Technology,  2017,  pp 010406-1 - 010406-6,  https://doi.org/10.2352/J.ImagingSci.Technol.2017.61.1.010406

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2017
  Article timeline 
  • received July 2016
  • accepted November 2016
  • PublishedJanuary 2017

Preprint submitted to:
  Login or subscribe to view the content