A method and apparatus for specifying quantization based upon the human visual system is described. In one embodiment, the method comprises specifying scalar quantization for application to one or more bit planes of luminance information in image data using a human visual system (HVS) weighting and quantizing bit planes of the luminance information in the image data based on specified scalar quantization.