Disclosed are sustained release compositions for vaginal or transdermal administration that contain a progesterone receptor modulator such as CDB-2914 (also referred to as VA-2914), and methods of using them for long term contraception or therapeutic purposes. Also disclosed are methods for making the compositions.