The present invention relates to a composition to be applied to hair or skin, which comprises (A) a surfactant and 0.00025 to 1 wt. % of (B) a perfume substance having an aromatic, pyran or furan ring and a carbonyl group, ether bond, carboxyl group or nonaromatic unsaturated bond, and having a CLogP value not greater than 1.5. The composition has a high perfume retentivity.