A coated article is provided so as to include an overcoat including zirconium oxide or chromium oxide. In certain example embodiments, the overcoat includes a dual layer overcoat including a nitride inclusive layer which supports a zirconium oxide (ZrO.sub.X) layer. In certain example embodiments, the overcoat may be of chromium oxide, with or without such a nitride inclusive layer.