An RGB light source that uses an optical fiber laser to generate a near-infrared (NIR) output light beam, and a wavelength conversion system that receives the output NIR light beam and forms therefrom red, green and blue light beams. The fiber laser includes multiple stages, wherein the first stage includes a solid-state laser to generate an initial NIR light beam. One or more subsequent stages operate to amplify the NIR light beam to form a relatively high-average-power output NIR light beam. Only light from the fiber laser is used to generate the red, green and blue-wavelength output light beams. The wavelength conversion system includes three or fewer non-linear optical (NLO) units. A color display that utilizes the RGB light source is also disclosed.