In this paper, we investigated the effects of visual and auditory adaptation on material appearance. The target in this study was metallic perception. First, participants evaluated CG images using sounds and other images. In the experiment, we prepared metallic stimulus under various adaptation conditions with different combinations of metal image, non-metal image, metal sound, and non-metal sound stimuli. After these adaptations, the participants answered "metal" or "non-metal" after viewing a displayed reference image. The reference images were generated by interpolating metal and non-metal images. Next, we analyzed the results and clarified the effects of visual, auditory, and audiovisual adaptations on the metallic perception. For analyzing results, we used a logistic regression analysis based on Bayesian statistics. From the analysis results, we found visual and auditory adaptation effects. On the other hand, we did not find the cross-modal effects of audiovisual adaptation. Finally, we created a model of the linear sum of the visual and audio adaptation effects on metallic material appearance.