We present a rapid measurement method for material appearance based on surface reflectance properties of threedimensional object. Conventional methods have some problems relating to the size, cost, and difficulty of operation. Appearance from Motion method proposed by Dong et al. is appropriate to conquer above problem. Their method challenged to estimate the surface reflectance under unknown lighting. However, a use of multiple unknown parameters causes the loss of convergence, and sometimes preys on the accuracy and computational cost. Therefore, we improved the algorithm of Appearance from Motion method to use the omni-directional camera for incident lighting component. We demonstrate valuable results for accuracy of reproduction and reduction of computational cost by using the omni-directional camera.