Systems and techniques for real-time 3D reconstruction with a depth camera are described herein. Depth measurements received from a depth camera of target may be stored in a depth-measurement data structure. A three-dimensional representation of the target may be stored in a model. A current depth image received from the depth camera may be registered to the model. The depth-measurement data structure may be modified with the current depth image based on the registration. The model may be deformed based on space carving and the modified depth measurement data structure.