Devices, systems, and techniques for analyzing video information to objectively identify patient behavior are disclosed. A system may analyze obtained video information of patient motion during a period of time to track one or more anatomical regions through a plurality of frames of the video information and calculate one or more movement parameters of the one or more anatomical regions. The system may also compare the one or more movement parameters to respective criteria for each of a plurality of predetermined patient behaviors and identify the patient behaviors that occurred during the period of time. In some examples, a device may control therapy delivery according to the identified patient behaviors and/or sensed parameters previously calibrated based on the identified patient behaviors.