The IEEE P1858 CPIQ Standard is a new industry standard for assessing camera image quality on mobile devices. The CPIQ standard provides test methodologies for evaluating seven image attributes: spatial frequency response, texture blur, visual noise, color uniformity, chroma level, lateral chromatic displacement, and local geometric distortion. In addition, the CPIQ standard provides mathematical transforms between objective metric values and perceived image quality quantifiable in just noticeable differences, and a framework to combine individual attributes into prediction of overall image quality. This study aims at validating the CPIQ set of image quality metrics and the CPIQ prediction of overall image quality. The two key components of the study are objective measurements of image quality in the lab and subjective evaluation of real-world images by human observers. Nine smartphones were used in the study, with the expected camera quality ranging from low to high. The CPIQ methodology was implemented and practiced in an industrial lab, and measurements of the CPIQ metrics were obtained at varying lighting conditions. The subjective evaluation study was performed in a university lab, using paired comparison and softcopy quality ruler as test methods. The results from this study revealed that objective measurements defined in the CPIQ standard are highly correlated with perceived image quality.
Elaine W. Jin, Jonathan B. Phillips, Susan Farnand, Margaret Belska, Vinh Tran, Ed Chang, Yixuan Wang, Benjamin Tseng, "Towards the Development of the IEEE P1858 CPIQ Standard – A validation study" in Proc. IS&T Int’l. Symp. on Electronic Imaging: Image Quality and System Performance XIV, 2017, pp 88 - 94, https://doi.org/10.2352/ISSN.2470-1173.2017.12.IQSP-249