Implementations described herein discloses, a method of AI based video tagging for alarm management includes receiving, using a processor, a video stream, the video stream comprising a sequence of images for at least a portion of a patient, determining, using the processor, a physiological parameter for the patient based on the sequence of images, detecting, using machine learning, presence of a noise object and setting a interaction-flag to a positive value in response to detecting the noise object, comparing a quality level of the sequence of images with a threshold quality level, and modifying an alarm level based on the value of the interaction-flag and comparison of the quality level of the sequence of depth images with the threshold quality level.