Back to articles
Proceedings Paper
Volume: 32 | Article ID: 12
Image
Intrinsic-GS: Multi-view Intrinsic Image Decomposition Using Gaussian Splatting and Color-Invariant Priors
  DOI :  10.2352/CIC.2024.32.1.12  Published OnlineOctober 2024
Abstract
Abstract

Despite significant advancements in single-view intrinsic image decomposition, a domain disparity exists due to the limited information that can be obtained from a single-view image and the ill-posed nature of the problem of intrinsic image decomposition. Multi-view images offer an alternative method to circumvent the ambiguity present in 2D intrinsic image decomposition. Building on the concepts of multi-view intrinsic images and recent neural rendering techniques, we propose Intrinsic-GS, a multiview intrinsic image decomposition method utilizing Gaussian-splatting. To achieve this, we first augment each Gaussian ellipsoid with additional attributes (i.e., albedo, shading, and a residual term) to model the intrinsic radiance field. Next, we use several color-invariants and physics-based priors to jointly regularize the optimization of the intrinsic and composited radiance fields. Finally, we conduct experiments on both synthetic and real-world datasets, demonstrating stable intrinsic decomposition results across various (including non-Lambertian) objects and scenes.

Subject Areas :
Views 50
Downloads 19
 articleview.views 50
 articleview.downloads 19
  Cite this article 

Xiaoyan Xing, Konrad Groh, Sezer Karaoglu, Theo Gevers, "Intrinsic-GS: Multi-view Intrinsic Image Decomposition Using Gaussian Splatting and Color-Invariant Priorsin Color and Imaging Conference,  2024,  pp 56 - 63,  https://doi.org/10.2352/CIC.2024.32.1.12

 Copy citation
  Copyright statement 
Copyright ©2024 Society for Imaging Science and Technology 2024
cic
Color and Imaging Conference
2166-9635
2166-9635
Society for Imaging Science and Technology
IS&T 7003 Kilworth Lane, Springfield, VA 22151 USA