A mechanism is described for facilitating visual anomaly detection without reference in computing environments. An apparatus of embodiments, as described herein, includes one or more processors to select a frame from a sequence of multiple frames associated with a video stream captured by a camera, and dynamically compute a frame confidence score for the frame based on frame training data associated with frame. The one or more processors are further to detect one or more anomalies in the frame when the frame confidence score is less than a frame confidence threshold associated with the frame, where detecting includes dynamically comparing the frame confidence score with the frame confidence threshold through inference using frame field data and the frame training data.