Medical devices and methods for making and using medical devices are disclosed. An example medical device may include a catheter shaft. An expandable balloon may be coupled to the catheter shaft. The balloon may be capable of shifting between a folded configuration and an expanded configuration. A support structure may be coupled to the balloon. The support structure may be capable of shifting the balloon toward the folded configuration. A plurality of elongate flexible electrode assemblies may be disposed on the balloon. The elongate flexible electrode assemblies may be oriented at an angle relative to a longitudinal axis of the balloon.