The choice of test images is an important part of the experimental evaluation of colour reproduction algorithms. As previous studies show low levels of correlation between individual image results, this study explores the impact of test image choice on the overall results of gamut mapping algorithm evaluation experiments. A set of fifteen test images is used in an experiment designed according to CIE TC8–03 Guidelines to evaluate the performance of six GMAs. The results first show the significant difference between how accurately individual images can be reproduced. Most importantly the results also show that five–image subsets can be selected so as to have each of the six GMAs in the top group for that set. Hence it is necessary to use greater numbers of test images in future experiments to obtain more robust and repeatable overall results.
Jan Morovic, Yu Wang, "Influence of Test Image Choice on Experimental Results" in Proc. IS&T 11th Color and Imaging Conf., 2003, pp 143 - 148, https://doi.org/10.2352/CIC.2003.11.1.art00025