-
公开(公告)号：US12282987B2
公开(公告)日：2025-04-22
申请号：US18053646
申请日：2022-11-08
Applicant: Adobe Inc.
Inventor： Zichuan Liu , Xin Lu , Ke Wang
Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating image mattes for detected objects in digital images without trimap segmentation via a multi-branch neural network. The disclosed system utilizes a first neural network branch of a generative neural network to extract a coarse semantic mask from a digital image. The disclosed system utilizes a second neural network branch of the generative neural network to extract a detail mask based on the coarse semantic mask. Additionally, the disclosed system utilizes a third neural network branch of the generative neural network to fuse the coarse semantic mask and the detail mask to generate an image matte. In one or more embodiments, the disclosed system also utilizes a refinement neural network to generate a final image matte by refining selected portions of the image matte generated by the generative neural network.
-
公开(公告)号：US20250005884A1
公开(公告)日：2025-01-02
申请号：US18215551
申请日：2023-06-28
Applicant: Adobe Inc.
Inventor： Zichuan Liu , Xin Lu , Mingyuan Wu
Abstract: In implementations of systems for efficient object segmentation, a computing device implements a segment system to receive a user input specifying coordinates of a digital image. The segment system computes receptive fields of a machine learning model based on the coordinates of the digital image. The machine learning model is trained on training data to generate segment masks for objects depicted in digital images. The segment system processes a portion of a feature map of the digital image using the machine learning model based on the receptive fields. A segment mask is generated for an object depicted in the digital image based on processing the portion of the feature map of the digital image using the machine learning model.
-
公开(公告)号：US11625813B2
公开(公告)日：2023-04-11
申请号：US17085491
申请日：2020-10-30
Applicant: Adobe Inc.
Inventor： Sheng-Wei Huang , Wentian Zhao , Kun Wan , Zichuan Liu , Xin Lu , Jen-Chan Jeff Chien
Abstract: The present disclosure describes systems, non-transitory computer-readable media, and methods for accurately and efficiently removing objects from digital images taken from a camera viewfinder stream. For example, the disclosed systems access digital images from a camera viewfinder stream in connection with an undesired moving object depicted in the digital images. The disclosed systems generate a temporal window of the digital images concatenated with binary masks indicating the undesired moving object in each digital image. The disclosed systems further utilizes a 3D to 2D generator as part of a 3D to 2D generative adversarial neural network in connection with the temporal window to generate a target digital image with the region associated with the undesired moving object in-painted. In at least one embodiment, the disclosed systems provide the target digital image to a camera viewfinder display to show a user how a future digital photograph will look without the undesired moving object.
-
4.发明公开公开(公告)号：US20240161364A1
公开(公告)日：2024-05-16
申请号：US18053646
申请日：2022-11-08
Applicant: Adobe Inc.
Inventor： Zichuan Liu , Xin Lu , Ke Wang
CPC classification number: G06T11/60 , G06T7/13 , G06V10/44 , G06T2207/20084
Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating image mattes for detected objects in digital images without trimap segmentation via a multi-branch neural network. The disclosed system utilizes a first neural network branch of a generative neural network to extract a coarse semantic mask from a digital image. The disclosed system utilizes a second neural network branch of the generative neural network to extract a detail mask based on the coarse semantic mask. Additionally, the disclosed system utilizes a third neural network branch of the generative neural network to fuse the coarse semantic mask and the detail mask to generate an image matte. In one or more embodiments, the disclosed system also utilizes a refinement neural network to generate a final image matte by refining selected portions of the image matte generated by the generative neural network.
-
公开(公告)号：US11335004B2
公开(公告)日：2022-05-17
申请号：US16988408
申请日：2020-08-07
Applicant: Adobe Inc.
Inventor： Zichuan Liu , Wentian Zhao , Shitong Wang , He Qin , Yumin Jia , Yeojin Kim , Xin Lu , Jen-Chan Chien
IPC: G06T7/11
Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that generate refined segmentation masks for digital visual media items. For example, in one or more embodiments, the disclosed systems utilize a segmentation refinement neural network to generate an initial segmentation mask for a digital visual media item. The disclosed systems further utilize the segmentation refinement neural network to generate one or more refined segmentation masks based on uncertainly classified pixels identified from the initial segmentation mask. To illustrate, in some implementations, the disclosed systems utilize the segmentation refinement neural network to redetermine whether a set of uncertain pixels corresponds to one or more objects depicted in the digital visual media item based on low-level (e.g., local) feature values extracted from feature maps generated for the digital visual media item.
-
Patent Agency Ranking
公开(公告)号：US12026857B2
公开(公告)日：2024-07-02
申请号：US18298146
申请日：2023-04-10
Applicant: Adobe Inc.
Inventor： Sheng-Wei Huang , Wentian Zhao , Kun Wan , Zichuan Liu , Xin Lu , Jen-Chan Jeff Chien
IPC: G06T5/77 , G06F18/2134 , G06T7/73 , H04N23/63
CPC classification number: G06T5/77 , G06F18/2134 , G06T7/73 , H04N23/631 , G06T2207/10016 , G06T2207/20081
Abstract: The present disclosure describes systems, non-transitory computer-readable media, and methods for accurately and efficiently removing objects from digital images taken from a camera viewfinder stream. For example, the disclosed systems access digital images from a camera viewfinder stream in connection with an undesired moving object depicted in the digital images. The disclosed systems generate a temporal window of the digital images concatenated with binary masks indicating the undesired moving object in each digital image. The disclosed systems further utilizes a generator as part of a 3D to 2D generative adversarial neural network in connection with the temporal window to generate a target digital image with the region associated with the undesired moving object in-painted. In at least one embodiment, the disclosed systems provide the target digital image to a camera viewfinder display to show a user how a future digital photograph will look without the undesired moving object.
-
公开(公告)号：US20220245824A1
公开(公告)日：2022-08-04
申请号：US17660361
申请日：2022-04-22
Applicant: Adobe Inc.
Inventor： Zichuan Liu , Wentian Zhao , Shitong Wang , He Qin , Yumin Jia , Yeojin Kim , Xin Lu , Jen-Chan Chien
IPC: G06T7/11
Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that generate refined segmentation masks for digital visual media items. For example, in one or more embodiments, the disclosed systems utilize a segmentation refinement neural network to generate an initial segmentation mask for a digital visual media item. The disclosed systems further utilize the segmentation refinement neural network to generate one or more refined segmentation masks based on uncertainly classified pixels identified from the initial segmentation mask. To illustrate, in some implementations, the disclosed systems utilize the segmentation refinement neural network to redetermine whether a set of uncertain pixels corresponds to one or more objects depicted in the digital visual media item based on low-level (e.g., local) feature values extracted from feature maps generated for the digital visual media item.
-
公开(公告)号：US20230274400A1
公开(公告)日：2023-08-31
申请号：US18298146
申请日：2023-04-10
Applicant: Adobe Inc.
Inventor： Sheng-Wei Huang , Wentian Zhao , Kun Wan , Zichuan Liu , Xin Lu , Jen-Chan Jeff Chien
IPC: G06T5/00 , G06T7/73 , G06F18/2134 , H04N23/63
CPC classification number: G06T5/005 , G06F18/2134 , G06T7/73 , H04N23/631 , G06T2207/10016 , G06T2207/20081
Abstract: The present disclosure describes systems, non-transitory computer-readable media, and methods for accurately and efficiently removing objects from digital images taken from a camera viewfinder stream. For example, the disclosed systems access digital images from a camera viewfinder stream in connection with an undesired moving object depicted in the digital images. The disclosed systems generate a temporal window of the digital images concatenated with binary masks indicating the undesired moving object in each digital image. The disclosed systems further utilizes a generator as part of a 3D to 2D generative adversarial neural network in connection with the temporal window to generate a target digital image with the region associated with the undesired moving object in-painted. In at least one embodiment, the disclosed systems provide the target digital image to a camera viewfinder display to show a user how a future digital photograph will look without the undesired moving object.
-
公开(公告)号：US11676283B2
公开(公告)日：2023-06-13
申请号：US17660361
申请日：2022-04-22
Applicant: Adobe Inc.
Inventor： Zichuan Liu , Wentian Zhao , Shitong Wang , He Qin , Yumin Jia , Yeojin Kim , Xin Lu , Jen-Chan Chien
IPC: G06T7/11
CPC classification number: G06T7/11 , G06T2207/20084
Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that generate refined segmentation masks for digital visual media items. For example, in one or more embodiments, the disclosed systems utilize a segmentation refinement neural network to generate an initial segmentation mask for a digital visual media item. The disclosed systems further utilize the segmentation refinement neural network to generate one or more refined segmentation masks based on uncertainly classified pixels identified from the initial segmentation mask. To illustrate, in some implementations, the disclosed systems utilize the segmentation refinement neural network to redetermine whether a set of uncertain pixels corresponds to one or more objects depicted in the digital visual media item based on low-level (e.g., local) feature values extracted from feature maps generated for the digital visual media item.
-
公开(公告)号：US20220164666A1
公开(公告)日：2022-05-26
申请号：US17100651
申请日：2020-11-20
Applicant: Adobe Inc.
Inventor： Zichuan Liu , Kun Wan , Xin Lu
Abstract: A method for performing efficient mixed-precision search for an artificial neural network (ANN) includes training the ANN by sampling selected candidate quantizers of a bank of candidate quantizer and updating network parameters for a next iteration based on outputs of layers of the ANN. The outputs are computed by processing quantized data with operators (e.g., convolution). The quantizers converge to optimal bit-widths that reduce classification losses bounded by complexity constrains.
-
-
-
-
-
-
-
-
-
Search Results
11
records
(took 0.028 seconds)
