In various example embodiments, a system and method for using machine learning to define user controls for image adjustment is provided. In example embodiments, a new image to be adjusted is received. A weight is applied to reference images of a reference dataset based on a comparison of content of the new image to the reference image of the reference dataset. A plurality of basis styles is generated by applying weighted averages of adjustment parameters corresponding to the weighted reference images to the new image. Each of the plurality of basis styles comprises a version of the new image with an adjustment of at least one image control based on the weighted averages of the adjustment parameters of the reference dataset. The plurality of basis styles is provided to a user interface of a display device.