Back to articles
Proceedings Paper
Volume: 37 | Article ID: IMAGE-274
Image
RGBD Routed Blending: A 3D Reconstruction Pipeline for Video Conferencing
  DOI :  10.2352/EI.2025.37.8.IMAGE-274  Published OnlineFebruary 2025
Abstract
Abstract

With the widespread use of video conferencing technology for remote communication in the workforce, there is an increasing demand for face-to-face communication between the two parties. To solve the problem of difficulty in acquiring frontal face images, multiple RGB-D cameras have been used to capture and render the frontal faces of target objects. However, the noise of depth cameras can lead to geometry and color errors in the reconstructed 3D surfaces. In this paper, we proposed RGBD Routed Blending, a novel two-stage pipeline for video conferencing that fuses multiple noisy RGB-D images in 3D space and renders virtual color and depth output images from a new camera viewpoint. The first stage is the geometry fusion stage consisting of an RGBD Routing Network followed by a Depth Integrating Network to fuse the RGB-D input images to a 3D volumetric geometry. As an intermediate product, this fused geometry is sent to the second stage, the color blending stage, along with the input color images to render a new color image from the target viewpoint. We quantitatively evaluate our method on two datasets, a synthetic dataset (DeformingThings4D) and a newly collected real dataset, and show that our proposed method outperforms the state-of-the-art baseline methods in both geometry accuracy and color quality.

Subject Areas :
Views 7
Downloads 0
 articleview.views 7
 articleview.downloads 0
  Cite this article 

Fan Bu, Qian Lin, Jan Allebach, "RGBD Routed Blending: A 3D Reconstruction Pipeline for Video Conferencingin Electronic Imaging,  2025,  pp 274-1 - 274-11,  https://doi.org/10.2352/EI.2025.37.8.IMAGE-274

 Copy citation
  Copyright statement 
Copyright © 2025, Society for Imaging Science and Technology
ei
Electronic Imaging
2470-1173
2470-1173
Society for Imaging Science and Technology
IS&T 7003 Kilworth Lane, Springfield, VA 22151 USA