In order to accurate color reproduction, a novel six-band stereoscopic video acquisition and visualization system using multi-spectral and stereo imaging has been proposed. The proposed system consists of two consumer-model digital cameras and an interference filter whose spectral transmittance is comb shaped. In the process of generating a six-band image, the Phase-Only Correlation method (POC) is used to find accurate corresponding points between the stereo image pair, and projective transformation whose parameters are estimated from the correspondence is used to correct geometric relationship between the images. The Wiener estimation method is used for color reproduction. The all image processing steps after image capture is implemented on GPUs and the frame rate of the system is 30 fps is achieved when image size is XGA.