-
公开(公告)号:US11256960B2
公开(公告)日:2022-02-22
申请号:US16849716
申请日:2020-04-15
Applicant: ADOBE INC.
Inventor: Joonyoung Lee , Sanghyun Woo , Dahun Kim
Abstract: A method, apparatus, non-transitory computer readable medium, and system for panoptic segmentation are described. Embodiments may generate a feature pyramid for an input image, wherein the feature pyramid comprises a plurality of feature maps at different resolution levels, apply an attention module to the feature pyramid to produce an enhanced feature map, combine the enhanced feature map with each of the plurality of feature maps to produce an enhanced feature pyramid, generate semantic information for the input image based on the enhanced feature pyramid, generate a plurality of object regions based on the enhanced feature pyramid, generate instance information for each of the plurality of object regions, and generate panoptic segmentation information for the input image based on the semantic information and the instance information for each of the plurality of object regions.
-
公开(公告)号:US20230316536A1
公开(公告)日:2023-10-05
申请号:US17657430
申请日:2022-03-31
Applicant: ADOBE INC.
Inventor: Joon-Young Lee , Seoungwug Oh , Sanghyun Woo , Kwanyong Park
IPC: G06T7/20 , G06T3/40 , G06T3/00 , G06V10/764 , G06V10/774 , G06V10/82 , G06V10/776 , G06N3/04
CPC classification number: G06T7/20 , G06T3/40 , G06T3/0006 , G06V10/764 , G06V10/774 , G06V10/82 , G06T2207/10016 , G06N3/0454 , G06T2207/20081 , G06T2207/20084 , G06T2207/20212 , G06T2207/20132 , G06V2201/07 , G06V10/776
Abstract: Systems and methods for object tracking are described. One or more aspects of the systems and methods include receiving a video depicting an object; generating object tracking information for the object using a student network, wherein the student network is trained in a second training phase based on a teacher network using an object tracking training set and a knowledge distillation loss that is based on an output of the student network and the teacher network, and wherein the teacher network is trained in a first training phase using an object detection training set that is augmented with object tracking supervision data; and transmitting the object tracking information in response to receiving the video.
-
公开(公告)号:US20210326638A1
公开(公告)日:2021-10-21
申请号:US16852647
申请日:2020-04-20
Applicant: ADOBE INC.
Inventor: Joon-Young Lee , Sanghyun Woo , Dahun Kim
Abstract: Systems and methods for panoptic video segmentation are described. A method may include identifying a target frame and a reference frame from a video, generating target features for the target frame and reference features for the reference frame, combining the target features and the reference features to produce fused features for the target frame, generating a feature matrix comprising a correspondence between objects from the reference features and objects from the fused features; and generating panoptic segmentation information for the target frame based on the feature matrix.
-
公开(公告)号:US11640714B2
公开(公告)日:2023-05-02
申请号:US16852647
申请日:2020-04-20
Applicant: ADOBE INC.
Inventor: Joon-Young Lee , Sanghyun Woo , Dahun Kim
Abstract: Systems and methods for panoptic video segmentation are described. A method may include identifying a target frame and a reference frame from a video, generating target features for the target frame and reference features for the reference frame, combining the target features and the reference features to produce fused features for the target frame, generating a feature matrix comprising a correspondence between objects from the reference features and objects from the fused features; and generating panoptic segmentation information for the target frame based on the feature matrix.
-
-
-