Human faces are considered an important type of stimuli integral to social interaction. Faces occupy a substantial share of digital content, and their appearance can meaningfully impact how they are perceived and evaluated. In particular, past work has shown that facial color appearance can directly influence such perceptions. However, little is known regarding the perception of facial gloss and its influence on facial skin color appearance. The current work investigates how skin roughness influences perceived facial gloss and how these in turn affect facial color appearance for 3D rendered faces. Here, “roughness” refers to a parameter of the microfacet function modeling the microscopic surface. Two psychophysical experiments were conducted to model the interaction among skin roughness, perceived facial gloss, and perceived facial color appearance using varied facial skin tones. The results indicated an exponential relationship between skin roughness and perceived facial gloss, which was consistent across different skin tones. Additionally, gloss appearance influenced the perceived lightness of faces, a pattern not observed to the same extent among non-face objects included in the experiment. We expect that these results might partially be explained by discounting specular components for surface color perception to infer color attributes and by simultaneous contrast induced by a concentrated specular highlight. The current findings provide guidance for predicting visual appearance of face and non-face objects and will be useful for gloss and color reproduction of rendered digital faces.