Orange peel is an important appearance quality factor that consists of an irregularity of a surface appearance that resembles the skin of an orange. Several measurement methods for evaluating orange peel have been proposed. However, the correlations of these methods with subjective evaluation scores are insufficient. The purpose of this paper is to develop a new measurement and evaluation method. The measurement system is composed of a spectral camera and lighting device for projecting an evaluation pattern on an object. An evaluation model using the frequency characteristics of the projected pattern image and human visual characteristics is proposed. The results show that the correspondence between the evaluation model values and subjective values is high. Because this method is based on visual inspection, it is expected to be suitable for a wide range of applications.