A vehicle occupant comfort system, comprises a processor that stores computer executable components stored in memory. A plurality of sensors sense ambient conditions associated with exterior and interior conditions of a vehicle. A context component infers or determines context of an occupant of the vehicle. A comfort model component implicitly and explicitly trained on occupant comfort related data analyzes information from the plurality of sensors and context component. A comfort controller adjusts environmental conditions of a passenger compartment of the vehicle based at least in part on output of the comfort model component.