-
公开(公告)号:US20230342991A1
公开(公告)日:2023-10-26
申请号:US17726304
申请日:2022-04-21
Applicant: Adobe Inc.
Inventor: Seoung Wug OH , Joon-Young LEE , Brian PRICE , John G. NELSON , Wujun WANG , Adam PIKIELNY
CPC classification number: G06T11/001 , G06T5/003 , G06N3/084 , G06T7/194 , G06T5/002 , G06T2207/20081 , G06T2207/20084
Abstract: Embodiments are disclosed for a machine learning-based chroma keying process. The method may include receiving an input including an image depicting a chroma key scene and a color value corresponding to a background color of the image. The method may further include generating a preprocessed image by concatenating the image and the color value. The method may further include providing the preprocessed image to a trained neural network. The method may further include generating, using the trained neural network, an alpha matte representation of the image based on the preprocessed image.
-
公开(公告)号:US20250029386A1
公开(公告)日:2025-01-23
申请号:US18356892
申请日:2023-07-21
Applicant: Adobe Inc.
Inventor: Joon-Young LEE , Seoung Wug OH , Ho Kei CHENG , Brian PRICE
Abstract: Embodiments are disclosed for performing universal segmentation to mask objects across multiple frames of a video. The method may include determining an image segmentation mask which masks an object of a frame of a video sequence using the frame and an image segmentation module of a segmentation system. The method further includes determining a mask propagation mask which masks the object of the frame of the video sequence using the frame, a representation of a previous frame of the video sequence, and a mask propagation module of the segmentation system. The method further includes determining a frame mask which masks the object of the frame of the video sequence based on a comparison of the image segmentation mask and the mask propagation mask. The method further includes displaying the frame mask of the video sequence.
-
公开(公告)号:US20240397059A1
公开(公告)日:2024-11-28
申请号:US18322310
申请日:2023-05-23
Applicant: Adobe Inc.
Inventor: Joon-Young LEE , Seoung Wug OH , Ho Kei CHENG , Brian PRICE
IPC: H04N19/172 , G06V10/25 , H04L9/32
Abstract: A method includes receiving a frame depicting an object. The frame is one frame of a plurality of frames of a video sequence. The method further includes encoding a plurality of tokens of the frame. Each token is a representation of a grid of pixels of the frame. The method further includes selecting a subset of tokens for decoding based on a likelihood of a token satisfying a confidence threshold. The token satisfies the confidence threshold based on a confidence score of the token including a past object in a past frame. The method further includes decoding the subset of tokens using a decoder.
-
公开(公告)号:US20240371002A1
公开(公告)日:2024-11-07
申请号:US18312858
申请日:2023-05-05
Applicant: Adobe Inc.
Inventor: Brian PRICE , Tai-Yu PAN , Qing LIU
IPC: G06T7/10 , G06V10/762 , G06V10/774 , G06V10/776 , G06V10/82
Abstract: A method includes receiving an object mask of an object in an image. The method further includes generating a mask of a sub-object in the image using a machine learning model configured to receive the mask of the object. A first branch of the machine learning model predicts whether a pixel of the image belongs to a sub-object.
-
公开(公告)号:US20240320838A1
公开(公告)日:2024-09-26
申请号:US18123658
申请日:2023-03-20
Applicant: ADOBE INC.
Inventor: Xuaner ZHANG , Xinyi WU , Markus Jamal WOODSON , Joon-Young LEE , Brian PRICE , Jiawen CHEN
CPC classification number: G06T7/194 , G06T7/174 , G06T7/337 , G06T2207/20081 , G06T2207/20084 , G06T2207/20221
Abstract: Systems and methods perform image matte generation using image bursts. In accordance with some aspects, an image burst comprising a set of images is received. Features of a reference image from the set of images is aligned with features of other images from the set of images. A matte for the reference image is generated using the aligned features.
-
公开(公告)号:US20230169658A1
公开(公告)日:2023-06-01
申请号:US17536384
申请日:2021-11-29
Applicant: Adobe Inc.
Inventor: Tenell RHODES , Brian PRICE , Gavin Stuart Peter MILLER , Kenji ENOMOTO
CPC classification number: G06T7/11 , H04N5/272 , G06T2207/10024 , G06T2207/10028
Abstract: Embodiments are disclosed for generating an instant mask from polarized input images. A method of generating the mask includes obtaining, by a user interface manager, a set of polarized input images, the set of polarized images including background images depicting a background and subject images depicting a foreground object in front of the background and backlit by a polarized light source, the set of polarized input images including more than two polarized images, each associated with a different polarization angle, determining, by a matte optimization manager, an at least partially polarized reflection on the foreground object based on the set of polarized input images, determining, by the matte optimization manager, an alpha matte based at least on intensity values associated with each of the set of polarized input images such that the alpha matte isolates the foreground object and removes the at least partially polarized reflection, and generating, by a matte generator, an output matte based on the alpha matte.
-
公开(公告)号:US20240201832A1
公开(公告)日:2024-06-20
申请号:US18066199
申请日:2022-12-14
Applicant: Adobe Inc.
Inventor: Brian PRICE , Yifei FAN , Joshua MYERS-DEAN
IPC: G06F3/04845 , G06T5/00 , G06T9/00 , G06V10/25 , G06V10/764 , G06V10/771
CPC classification number: G06F3/04845 , G06T5/005 , G06T9/00 , G06V10/25 , G06V10/764 , G06V10/771 , G06T2207/20104
Abstract: Embodiments are disclosed for predicting a user's intent to generate a masked region of an image based on a user gesture. The method may include receiving a user interaction corresponding to a region in an image. The user interaction is used to select the object in the image. The method further includes generating a feature map using a first machine learning model and the user interaction, where the feature map includes at least one feature corresponding to a mode type. The mode type is an intended operation of a user. Lastly, the method includes generating a mask of the object in the image using a second machine learning model, wherein the mask is generated responsive to the mode type.
-
公开(公告)号:US20230410553A1
公开(公告)日:2023-12-21
申请号:US17842056
申请日:2022-06-16
Applicant: ADOBE INC.
Inventor: Xin LU , Simon Su CHEN , Jingyuan LIU , He ZHANG , Brian PRICE , Calista CHANDLER
CPC classification number: G06V40/162 , G06T2207/10024 , G06T5/001 , G06V40/172
Abstract: An image processing system auto white balances an image using an object in the image and a reference color distribution. Given an input image, a target object in the input image is identified. A reference color distribution for the object type of the target object from the input image is accessed. One or more image processing settings are determined that, when applied to the input image, minimize a difference in values between pixels of the target object and the reference color distribution. A white balanced image is generated by applying the one or more image processing settings to the input image, and the white balanced image is provided for presentation.
-
-
-
-
-
-
-