A chemical amplification resist composition comprising (A) a resin increasing the solubility in an alkali developer by the action of an acid, (B) a compound capable of generating an acid upon irradiation with actinic ray or radiation, (C) a compound having a fluorine atom and a hydroxyl group, and a pKa value of from 4 to 15, and (D) a solvent, and a pattern-forming method using the same.