Hybrid-resolution multispectral imaging has been proposed for reconstructing multispectral images from two types of data with different spatial and spectral resolutions. This paper proposes a new scheme for hybrid-resolution multispectral imaging based on image sensors with a multispectral filter array (MSFA). The proposed method reconstructs multispectral images from a high-resolution RGB image and image data from an MSFA with narrow-band color filters. The MSFA samples each band of a multispectral image sparsely in space, while RGB images are obtained at high spatial resolution; i.e., this dataset is regarded as a hybridresolution measurement. In the multispectral image reconstruction, each band of a multispectral image is reconstructed as a linear combination of high-resolution RGB images. The weighting coefficients of the linear combination are determined on the basis of MSFA data. By determining the weighting coefficients for each appropriate small area, overall multispectral images can be reconstructed with high accuracy. In this paper, typical configurations of image sensors for the hybrid-resolution multispectral imaging are also proposed. The effectiveness of the proposed method was verified for 16-band images through computer simulations in the case of a single-panel image sensor with an MSFA. As a result, it was confirmed that the proposed method reconstructed 16-band images at higher spatial resolution and with lower normalized root mean squared error than did a simple linear interpolation of the data from an equidensitysampling MSFA.
Yuri Murakami, Masahiro Yamaguchi, Nagaaki Ohyama, "Hybrid-resolution multispectral imaging based on color filter array: basic principles and computer simulation" in Proc. IS&T CGIV 2012 6th European Conf. on Colour in Graphics, Imaging, and Vision, 2012, pp 259 - 265, https://doi.org/10.2352/CGIV.2012.6.1.art00045