Back to articles
Articles
Volume: 32 | Article ID: art00022
Image
Effective ISP Tuning Framework Based on User Preference Feedback
  DOI :  10.2352/ISSN.2470-1173.2020.9.IQSP-316  Published OnlineJanuary 2020
Abstract

This paper presents an effective tuning framework between CMOS Image Sensor (CIS) and Image Signal Processor (ISP) based on user preference feedback. One of key issue in ISP tuning is how to apply individual's subjectivity of Image Quality (IQ) in systematic way. In order to mitigate this issue, we propose a framework that efficiently surveys user preference of IQ and select ISP parameter based on those preferences. The overall processes are done on large-scale image database generated by an ISP simulator. In preference survey part, we make clusters that consist of perceptually similar images and gather user’s feedback on representative images of each cluster. Next, for training user preference, we train a DNN model according to general preference, and fine-tune model to optimize individuals preference based on user feedback. The model provides ISP candidate most similar to the preferences. In order to assess performance, the proposed framework was evaluated with a state-of-art CIS and ISP system. The experimental results indicate that the proposed framework converges the IQ score according to user feedback and find the ISP parameters that have higher quality IQ as compared with hand-tuned results.

Subject Areas :
Views 26
Downloads 14
 articleview.views 26
 articleview.downloads 14
  Cite this article 

Cheoljong Yang, Jinhyun Kim, Jungmin Lee, Younghoon Kim, Sung-Su Kim, TaeHyung Kim, JoonSeo Yim, "Effective ISP Tuning Framework Based on User Preference Feedbackin Proc. IS&T Int’l. Symp. on Electronic Imaging: Image Quality and System Performance XVII,  2020,  pp 316-1 - 316-5,  https://doi.org/10.2352/ISSN.2470-1173.2020.9.IQSP-316

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2020
72010604
Electronic Imaging
2470-1173
Society for Imaging Science and Technology
7003 Kilworth Lane, Springfield, VA 22151 USA