公开(公告)号：US20250029386A1

公开(公告)日：2025-01-23

申请号：US18356892

申请日：2023-07-21

Applicant: Adobe Inc.

Inventor： Joon-Young LEE ,  Seoung Wug OH ,  Ho Kei CHENG ,  Brian PRICE

IPC: G06V20/40 ,  G06T7/174 ,  G06T7/187 ,  G06T7/194 ,  G06V10/77

Abstract: Embodiments are disclosed for performing universal segmentation to mask objects across multiple frames of a video. The method may include determining an image segmentation mask which masks an object of a frame of a video sequence using the frame and an image segmentation module of a segmentation system. The method further includes determining a mask propagation mask which masks the object of the frame of the video sequence using the frame, a representation of a previous frame of the video sequence, and a mask propagation module of the segmentation system. The method further includes determining a frame mask which masks the object of the frame of the video sequence based on a comparison of the image segmentation mask and the mask propagation mask. The method further includes displaying the frame mask of the video sequence.

公开(公告)号：US20240397059A1

公开(公告)日：2024-11-28

申请号：US18322310

申请日：2023-05-23

Applicant: Adobe Inc.

Inventor： Joon-Young LEE ,  Seoung Wug OH ,  Ho Kei CHENG ,  Brian PRICE

IPC: H04N19/172 ,  G06V10/25 ,  H04L9/32

Abstract: A method includes receiving a frame depicting an object. The frame is one frame of a plurality of frames of a video sequence. The method further includes encoding a plurality of tokens of the frame. Each token is a representation of a grid of pixels of the frame. The method further includes selecting a subset of tokens for decoding based on a likelihood of a token satisfying a confidence threshold. The token satisfies the confidence threshold based on a confidence score of the token including a past object in a past frame. The method further includes decoding the subset of tokens using a decoder.