Color vision deficiency is the decreased ability to perceive color differences. To overcome this deficiency, supporting techniques for realizing barrier-free color environments are required. This paper proposes a color appearance control system to enable people afflicted with color vision deficiency to easily distinguish between confusing colors on any printed images using a projector-camera system. The proposed system captures a printed image using a video camera and shifts the lightness components of each pixel by super-imposing a compensation image obtained from the projector device onto the printed image. The compensation image is produced in the CIEL*a*b* color space for iteratively adjusting the desired lightness components toward the target lightness. The feasibility of the proposed system is verified experimentally using real printed images.