An apparatus and method for driving an image display device using a DMD are provided. The apparatus includes a color wheel, an optical sensor, a delay time determining unit, and a control unit. The color wheel includes a plurality of color filters and index marks formed at positions corresponding to boundary lines between the color filters, and the optical sensor detects the index marks during rotation of the color wheel and outputs detection signals. The delay time determining unit determines a delay time corresponding to a minimum margin required in a conversion of a color image signal according to the detection signal inputted from the optical sensor, and the control unit controls a DMD based on the detection signals and the delay time.