This paper proposes a method for reconstructing the scene appearance of fluorescent objects under different conditions of materials and light source. First, the observed spectral image of two fluorescent objects with the mutual illumination effect is described by the multiplication of the spectral functions and the geometric factors. Second, the observed image is decomposed into spectral component images by the ridge regression approach. Third, the geometric factor of the self-luminescent component is separated into the direct and indirect illumination components by taking the spatial distributions of reflection and interreflection into account. Then the scene appearance of the two fluorescent objects under different conditions is reconstructed using the five components of (1) reflection, (2) interreflection, (3) luminescence by direct illumination, (4) luminescence by indirect illumination, and (5) interreflection by fluorescent illumination. The feasibility is shown using two scenes consisting of two fluorescent objects.