In this paper, for producing realistic color fabric images, we investigate perceptual dependencies in fabric appearance between texture and color. Color fabric images are synthesized using combinations of textures and color patterns. Texture patterns are extracted from fabric surface images, whereas color patterns are obtained done from colored pattern images. Color patterns are transferred onto texture patterns in the YIQ color space through our proposed algorithm. For validating the algorithm, we conducted two subjective evaluation experiments. The first experiment was conducted for evaluating the unnaturalness of synthesized color fabric images. Experimental results indicated that the unnaturalness depended on the relationship of the frequency between texture and color patterns. Then, we conducted a second experiment to evaluate our proposed technique for reducing unnaturalness. For reducing the unnaturalness of synthesized color fabric images, we applied the Gaussian filter to inputted colored pattern images. The results of the second experiment showed that the unnaturalness can be reduced by applying appropriate standard deviations of the Gaussian filter. Finally, we developed a model to estimate the standard deviations from input color and fabric images. We also showed that the model has sufficient estimation accuracy.