A method, apparatus and computer program product are provided in order to construct a visual representation of a video including one or more segmented objects from the frames of the video. In the context of a method, an object that appears in a plurality of frames of a video is identified. The method also includes segmenting the object from one or more frames of the video to create one or more segmented objects. The method further includes constructing a three-dimensional visual representation of the video including a representation of at least one frame of the video that includes the object. The three-dimensional visual representation also includes the one or more segmented objects positioned in a time sequence relative to the at least one frame of the video.