A solution of a chromium compound is impregnated into a silica-alumina carrier made of alumina and containing 1 to 5 weight % of silica relative to the weight of the carrier, thereby to obtain a decomposing catalyst carrying 10 to 15 weight % of chromium oxide relative to the weight of the catalyst in terms of Cr.sub.2O.sub.3. By contacting mixed gas obtained through partial oxidation of heavy oil and/or coal with the decomposing catalyst, COS and HCN contained in the mixed gas are decomposed/removed. In this case, transition of alumina into boehmite can be suppressed owing to coexistence of silica and chromium oxide, so that COS and HCN can be decomposed by highly active catalytic reactions over a long time.