Pair comparison methods based on Case V of Thurstone's Law of Comparative Judgment are widely used to derive interval scales for perceptual image quality. A thorough treatment of the involved statistical errors is often neglected, even though this is the base for computing confidence intervals and other statistical tests. In this paper we show, that consequent error estimation through all steps of the data analysis provides a simple and reliable method to compute confidence intervals. Monte Carlo simulations are used to verify the results and to compare the proposed error estimation with other known methods.
Peter Zolliker, Zofia Barańczuk, "Error estimation of paired comparison tests for Thurstone's Case V" in Proc. IS&T CGIV 2010/MCS'10 5th European Conf. on Colour in Graphics, Imaging, and Vision 12th Int'l Symp. on Multispectral Colour Science, 2010, pp 39 - 44, https://doi.org/10.2352/CGIV.2010.5.1.art00007