Disclosed herein is an image compression apparatus including: a pre-processing means for effecting preprocessing to generate color imaging signals of locations spatially equivalent to the relative locations of pixels on a color filter from color imaging signals outputted from a solid-state imaging device having the color filter having a predetermined color arrangement disposed on a light receiving surface thereof and to convert the color imaging signals into a predetermined arrangement format color by color with keeping color space of the color filter so as to generate image data groups; and an image compression means containing a frequency converting section for treating an image data group arranged in the predetermined arrangement format as one unit to compute spatial frequency components within the one unit, a quantizing section for quantizing the spatial frequency components, and a coding section for coding the quantized spatial frequency components.