Recent research efforts have focused on combining high dynamic range (HDR) imaging with super-resolution (SR) reconstruction to enhance both the intensity range and resolution of images beyond the apparent limits of the sensors that capture them. The processes developed to date start with a set of multiple-exposure input images with low dynamic range (LDR) and low resolution (LR), and require several procedural steps: conversion from LDR to HDR, SR reconstruction, and tone mapping. Input images captured with irregular exposure steps have an impact on the quality of the output images from this process. In this paper, we present a simplified framework to replace the separate procedures of previous methods that is also robust to different sets of input images. The proposed method first calculates weight maps to determine the best visible parts of the input images. The weight maps are then applied directly to SR reconstruction, and the best visible parts for the dark and highlighted areas of each input image are preserved without LDR-to-HDR conversion, resulting in high dynamic range. A new luminance control factor (LCF) is used during SR reconstruction to adjust the luminance of input images captured during irregular exposure steps and ensure acceptable luminance of the resulting output images. Experimental results show that the proposed method produces SR images of HDR quality with luminance compensation.
Tae-Hyoung Lee, Ho-Gun Ha, Yeong-Ho Ha, "Reconstruction of Super Resolution High Dynamic Range Image from Multiple-Exposure Images" in Proc. IS&T 19th Color and Imaging Conf., 2011, pp 195 - 200, https://doi.org/10.2352/CIC.2011.19.1.art00040