Back to articles
Volume: 31 | Article ID: art00012
Real-Time Photo-Realistic Augmented Reality Under Dynamic Ambient Lighting Conditions
  DOI :  10.2352/ISSN.2470-1173.2019.2.ERVR-186  Published OnlineJanuary 2019

Despite all major developments in graphics hardware, realistic rendering is still a computational challenge in real-time augmented reality (AR) applications deployed on portable devices. We have developed a real-time photo-realistic AR system which captures environment lighting dynamically, computes second order spherical harmonic (SH) coefficients of it on the CPU and the resulting nine coefficients on the AR device for real-time rendering. Our technique provides a very computationally efficient rendering procedure for diffuse objects in real-time rendering scenarios. We use two options for dynamic photometric registration of environments: a Ricoh Theta S 360° camera, and a Raspberry Pi Zero mini PC with a camera with a 180° fisheye lens. We tested our system successfully with software developed in Unity 3D with the Vuforia AR package, running on a Microsoft Hololens, and also an Oculus Rift DK2 with a stereo camera add-on.

Subject Areas :
Views 17
Downloads 4
 articleview.views 17
 articleview.downloads 4
  Cite this article 

Kamran Alipour, Jürgen P Schulze, "Real-Time Photo-Realistic Augmented Reality Under Dynamic Ambient Lighting Conditionsin Proc. IS&T Int’l. Symp. on Electronic Imaging: The Engineering Reality of Virtual Reality,  2019,  pp 186-1 - 186-6,

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2019
Electronic Imaging
Society for Imaging Science and Technology
7003 Kilworth Lane, Springfield, VA 22151 USA