Various systems and methods for processing video data, including gesture masking in a video feed, are provided herein. The system can include a camera system interface to receive video data from a camera system; a gesture detection unit to determine a gesture within the video data, the gesture being performed by a user; a permission module to determine a masking permission associated with the gesture; and a video processor. The video processor can modify a portion of the video data associated with the gesture in accordance with the masking permission, and cause the portion of the video data to be displayed. The camera system includes a depth camera or an infrared camera. The gesture detection unit determines the gesture based on machine learning.