Video conferencing has become extremely relevant in the world in the latest years. Traditional image and video quality evaluation techniques prove insufficient to properly assess the quality of these systems, since they often include special processing pipelines, for example, to improve face rendering. Our team proposes a suite of equipment, laboratory scenes and measurements that include realistic mannequins to simulate a more true-to-life scene, while still being able to reliably measure image quality in terms of exposure, dynamic range, color and skin tone rendering, focus, texture, and noise. These metrics are used to evaluate and compare three categories of cameras for video conference that are available on the market: external webcams, laptop integrated webcams and selfie cameras of mobile devices. Our results showed that external webcams provide a real image quality advantage over most built-in webcams in laptops but cannot match the superior image quality of tablets and smartphones selfie cameras. Our results are consistent with perceptual evaluation and allow for an objective comparison of very different systems.
Rafael Falcon, Mauro Patti, Stanislas Brochard-Garnier, Gabriel Pacianotto Gouveia, Santiago Torres Acevedo, Thelma Bergot, Rick Alarcon, Corentin Bomstein, Hervé Macudzinski, Pierre-Yves Maitre, Laurent Chanas, Hoang-Phi Nguyen, Benoit Pochon, Frédéric Guichard, "Image quality evaluation of video conferencing solutions with realistic laboratory scenes" in Proc. IS&T Int’l. Symp. on Electronic Imaging: Image Quality and System Performance, 2022, pp 318-1 - 318-9, https://doi.org/10.2352/EI.2022.34.9.IQSP-318