Apparatuses, methods, systems, and program products are disclosed for fit adjustment of a head mounted display. An apparatus includes a processor and a memory that stores code executable by the processor. The code is executable by the processor to identify a user based on information captured using one or more sensors of a head mounted display (“HMD”) unit. The code is executable by the processor to determine one or more fit settings for the identified user, the one or more fit settings for sizing the HMD unit to the identified user. The code is executable by the processor to automatically adjust the HMD unit based on the determined one or more fit settings for the identified user.