Back to articles
Articles
Volume: 31 | Article ID: art00012
Image
Real-Time Photo-Realistic Augmented Reality Under Dynamic Ambient Lighting Conditions
Kamran Alipour
Jürgen P Schulze
  DOI :  10.2352/ISSN.2470-1173.2019.2.ERVR-186  Published Online :  January 2019
Abstract

Despite all major developments in graphics hardware, realistic rendering is still a computational challenge in real-time augmented reality (AR) applications deployed on portable devices. We have developed a real-time photo-realistic AR system which captures environment lighting dynamically, computes second order spherical harmonic (SH) coefficients of it on the CPU and the resulting nine coefficients on the AR device for real-time rendering. Our technique provides a very computationally efficient rendering procedure for diffuse objects in real-time rendering scenarios. We use two options for dynamic photometric registration of environments: a Ricoh Theta S 360° camera, and a Raspberry Pi Zero mini PC with a camera with a 180° fisheye lens. We tested our system successfully with software developed in Unity 3D with the Vuforia AR package, running on a Microsoft Hololens, and also an Oculus Rift DK2 with a stereo camera add-on.

Journal Title : Electronic Imaging
Publisher Name : Society for Imaging Science and Technology
Publisher Location : 7003 Kilworth Lane, Springfield, VA 22151 USA
Subject Areas :
Views 23
Downloads 4
 DOI 10.2352/ISSN.2470-1173.2019.2.ERVR-186
 articleview.views 23
 articleview.downloads 4
  Cite this article 

Kamran Alipour, Jürgen P Schulze, "Real-Time Photo-Realistic Augmented Reality Under Dynamic Ambient Lighting Conditions"  in Proc. IS&T Int’l. Symp. on Electronic Imaging: The Engineering Reality of Virtual Reality,  2019,  pp 186-1 - 186-6,  https://doi.org/10.2352/ISSN.2470-1173.2019.2.ERVR-186

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2019
72010604
Electronic Imaging
2470-1173
Society for Imaging Science and Technology
7003 Kilworth Lane, Springfield, VA 22151 USA
10.2352/ISSN.2470-1173.2019.2.ERVR-186
2470-1173(20190113)2019:2L.1861;1-
ei_24701173_v2019n2_input/s13.xml
/ist/ei/2019/00002019/00000002/art00012
Articles
Real-Time Photo-Realistic Augmented Reality Under Dynamic Ambient Lighting Conditions
AlipourKamran
SchulzeJürgen P
13012019
2019
2
186-1
186-6
2019
Despite all major developments in graphics hardware, realistic rendering is still a computational challenge in real-time augmented reality (AR) applications deployed on portable devices. We have developed a real-time photo-realistic AR system which captures environment lighting dynamically, computes second order spherical harmonic (SH) coefficients of it on the CPU and the resulting nine coefficients on the AR device for real-time rendering. Our technique provides a very computationally efficient rendering procedure for diffuse objects in real-time rendering scenarios. We use two options for dynamic photometric registration of environments: a Ricoh Theta S 360° camera, and a Raspberry Pi Zero mini PC with a camera with a 180° fisheye lens. We tested our system successfully with software developed in Unity 3D with the Vuforia AR package, running on a Microsoft Hololens, and also an Oculus Rift DK2 with a stereo camera add-on.
Augmented RealityPhoto-realisticAmbient LightingReal-timeSpherical harmonicsDiffuse lightinglow frequency lighting