A depth camera assembly (DCA) determines distances between the DCA and objects in a local area within a field of view of the DCA. The DCA projects a series of sinusoidal patterns into the local area DCA and captures images of the sinusoidal patterns via a sensor. The DCA determines a distance between the DCA and locations in the local area based on a phase shift each of the sinusoidal patterns captured by each pixel of the sensor. Initially, a calibration offset is determined for each pixel of the sensor by emitting the sinusoidal patterns onto a target at a predetermined distance from the DCA and using phase shifts for a pixel and the predetermined distance to determine the pixel's calibration offset.