A medical evaluation system includes an I/O module, a processing module, and an analysis module. The I/O module receives sensory data obtained by a motion sensor disposed in a mobile device carried by a patient at least when the patient is in a non-clinical environment. The processing module extracts medically relevant data from the sensory data received from the sensor in the mobile device. The relevant data includes one or more features of interest in the sensory data. The analysis module derives one or more surrogate biomarkers from the relevant data. The surrogate biomarkers represent at least one of a state or a progression of a medical condition of the patient. The mobile device may be a mobile phone carried by the patient and the sensor may include at least one of an accelerometer or a gyroscope that generates the sensory data to represent movements of the patient.