Various systems and methods for frame removal and replacement for stop-action animation are described herein. A system for creating a stop-motion video includes an access module to access a series of frames of an input video, and a processing module to determine whether each frame of the series of frames includes a portion of a hand and composite frames from the series of frames that do not include the portion of the hand to render an output video. A system for creating a video includes an access module to access an input video, and a video processing module to identify a physical object in the input video, track movement of the physical object in the input video to identify a path, identify a three-dimensional model of the physical object, and create an output video with the three-dimensional model in place of the physical object, the three-dimensional model following the path.