Contraceptive devices which are effective for extended periods of time are described, in the form of means for releasing an effective amount of a gonadotropin hormone releasing hormone composition and means for releasing an effective amount of an estrogenic hormone over a first period of time, and means for releasing an effective amount of a progestogen for a second period of time, the second period of time being substantially shorter than and running simultaneously with a portion of the first period of time. The gonadotropin hormone releasing hormone composition is selected from gonadotropin hormone releasing hormone, gonadotropin hormone releasing hormone analogues, gonadotropin hormone releasing hormone agonists, gonadotropin hormone releasing hormone antagonists and mixtures thereof. Contraceptive methods employing the devices are also described.