In a stereoscopic color image processing apparatus, a stereo calculation circuit calculates a parallax of respective primary colors by performing a stereo matching with respect to a pair of color images composed of three primary colors. A combination processing section calculates a combined parallax with respect to a picture element block according to an weighted averaging using respective primary color parallaxes and weighting factors.