A system (1) for producing a depth map of a video sequence comprises a client (C) and a server (S) connected by a network (N). A secondary video sequence (M*) available at the client (C) is derived from a primary video sequence (M) available at the server (S), the primary video sequence (M) having a primary depth map (D). The server comprises a transmission unit for transmitting the primary depth map (D) to the client. The client comprises an alignment unit for aligning the primary depth map (D) with the secondary video sequence (M*) so as to produce alignment information (AI), and a derivation unit for deriving the secondary depth map (D*) from the primary depth map (D) using the alignment information (AI).