Many research results indicated that the surround condition of image display could be a very important factor for image appearance. The most significant impact of the surround on image appearance is the change in perceived image contrast. The chromatic perception of the image will also depend on the color of surround. In this research, a psychophysical experiment was carried out to investigate surround color perception and its relationship with color matching functions and the impact of the macula. The first phase of the experiment was color matching across the center of the viewing field and the peripheral viewing field. The second phase of the experiment is verifying that the systematic color shift shown in the results of phase one was surround dependent but not device dependent. The result also showed that the 10° CMFs (color matching functions) are better than 2° CMFs to predict the tristimulus values of the display color when surround was considered. But neither 10° CMFs nor 2° CMFs could accurately predict surround color. A non-linear model was designed to predict the surround color perception. This model used a spectral filter, which was designed based on the density of Macula pigment. The results showed that this model could successfully predict surround color. The result of this research will help to better understand the impact of the surround on color and image appearance.