A monomer comprising vinylidene fluoride as a principal component is suspension-polymerized by supplying the monomer in division to a polymerization system containing a polymerization initiator at a pressure below a critical pressure Pcr (=4.38 MPa) of vinylidene fluoride and at a pressure above Pcr. As a result, a vinylidene fluoride polymer having excellent high-temperature coloring resistance and with remarkably less elution of organic matter and ionic components is produced, without using a specific halogenated hydrocarbon and without incurring troublesome labor and cost for recovery thereof.