-
公开(公告)号:US11830209B2
公开(公告)日:2023-11-28
申请号:US17651524
申请日:2022-02-17
Applicant: Snap Inc.
Inventor: Travis Chen , Samuel Edward Hare , Yuncheng Li , Tony Mathew , Jonathan Solichin , Jianchao Yang , Ning Zhang
IPC: G06T7/50 , G06T19/20 , G06T7/20 , G06T19/00 , G06T7/73 , G06V10/20 , G06V20/20 , G06V20/40 , G06V10/764 , G06V20/64
CPC classification number: G06T7/50 , G06T7/20 , G06T7/73 , G06T19/006 , G06T19/20 , G06V10/255 , G06V10/764 , G06V20/20 , G06V20/40 , G06V20/64 , G06T2207/10016 , G06T2207/20084 , G06T2210/12 , G06T2219/2016
Abstract: Systems, devices, media, and methods are presented for object detection and inserting graphical elements into an image stream in response to detecting the object. The systems and methods detect an object of interest in received frames of a video stream. The systems and methods identify a bounding box for the object of interest and estimate a three-dimensional position of the object of interest based on a scale of the object of interest. The systems and methods generate one or more graphical elements having a size based on the scale of the object of interest and a position based on the three-dimensional position estimated for the object of interest. The one or more graphical elements are generated within the video stream to form a modified video stream. The systems and methods cause presentation of the modified video stream including the object of interest and the one or more graphical elements.
-
公开(公告)号:US11645834B2
公开(公告)日:2023-05-09
申请号:US16949856
申请日:2020-11-17
Applicant: Snap Inc.
Inventor: Wei Han , Jianchao Yang , Ning Zhang , Jia Li
IPC: G06K9/62 , G06K9/46 , G06K9/52 , G06K9/66 , G06T3/40 , G06V10/42 , G06V10/44 , G06V10/46 , G06V30/194 , G06N3/04 , G06N3/084
CPC classification number: G06K9/6267 , G06K9/627 , G06K9/6256 , G06T3/40 , G06V10/42 , G06V10/44 , G06V10/462 , G06V30/194 , G06N3/0454 , G06N3/084 , G06V10/454
Abstract: Systems, devices, media, and methods are presented for identifying and categorically labeling objects within a set of images. The systems and methods receive an image depicting an object of interest, detect at least a portion of the object of interest within the image using a multilayer object model, determine context information, and identify the object of interest included in two or more bounding boxes.
-
公开(公告)号:US11551059B1
公开(公告)日:2023-01-10
申请号:US16192457
申请日:2018-11-15
Applicant: Snap Inc.
Inventor: Linjie Yang , Jianchao Yang , Xuehan Xiong , Yanran Wang
Abstract: A modulated segmentation system can use a modulator network to emphasize spatial prior data of an object to track the object across multiple images. The modulated segmentation system can use a segmentation network that receives spatial prior data as intermediate data that improves segmentation accuracy. The segmentation network can further receive visual guide information from a visual guide network to increase tracking accuracy via segmentation.
-
公开(公告)号:US11483268B2
公开(公告)日:2022-10-25
申请号:US16918343
申请日:2020-07-01
Applicant: Snap Inc.
Inventor: Jianchao Yang , Yuke Zhu , Ning Xu , Kevin Dechau Tang , Jia Li
IPC: G06F17/00 , H04L51/10 , G06F16/22 , G06F16/51 , G06F16/583 , G06N20/00 , G06F16/9535 , G06F16/954 , G06F16/2457 , G06F16/951 , G06N3/04 , G06N3/08 , G06V20/00 , H04L51/52 , G06T7/00 , H04L67/01 , H04L67/55
Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system communicates at least a portion of a first content collection to a first client device, and receives a first selection communication in response, the first selection communication identifying a first piece of content of the first plurality of pieces of content. The server analyzes analyzing the first piece of content to identify a set of context values for the first piece of content, and accesses accessing a second content collection comprising pieces of content sharing at least a portion of the set of context values of the first piece of content. In various embodiments, different content values, image processing operations, and content selection operations are used to curate the content collections.
-
公开(公告)号:US11361489B2
公开(公告)日:2022-06-14
申请号:US16946346
申请日:2020-06-17
Applicant: Snap Inc.
Inventor: Linjie Yang , Kevin Dechau Tang , Jianchao Yang , Jia Li
Abstract: A dense captioning system and method is provided for analyzing an image to generate proposed bounding regions for a plurality of visual concepts within the image, generating a region feature for each proposed bounding region to generate a plurality of region features of the image, and determining a context feature for the image using a proposed bounding region that is a largest in size of the proposed bounding regions. For each region feature of the plurality of region features of the image, the dense captioning system and method further provides for analyzing the region feature to determine for the region feature a detection score that indicates a likelihood that the region feature comprises an actual object, and generating a caption for a visual concept in the image using the region feature and the context feature when a detection score is above a specified threshold value.
-
公开(公告)号:US11308706B2
公开(公告)日:2022-04-19
申请号:US16927273
申请日:2020-07-13
Applicant: Snap Inc.
Inventor: Jia Li , Linjie Luo , Rahul Bhupendra Sheth , Ning Xu , Jianchao Yang
Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.
-
公开(公告)号:US11288879B2
公开(公告)日:2022-03-29
申请号:US15929374
申请日:2020-04-29
Applicant: Snap Inc.
Inventor: Travis Chen , Samuel Edward Hare , Yuncheng Li , Tony Mathew , Jonathan Solichin , Jianchao Yang , Ning Zhang
Abstract: Systems, devices, media, and methods are presented for object detection and inserting graphical elements into an image stream in response to detecting the object. The systems and methods detect an object of interest in received frames of a video stream. The systems and methods identify a bounding box for the object of interest and estimate a three-dimensional position of the object of interest based on a scale of the object of interest. The systems and methods generate one or more graphical elements having a size based on the scale of the object of interest and a position based on the three-dimensional position estimated for the object of interest. The one or more graphical elements are generated within the video stream to form a modified video stream. The systems and methods cause presentation of the modified video stream including the object of interest and the one or more graphical elements.
-
公开(公告)号:US20210295874A1
公开(公告)日:2021-09-23
申请号:US17303817
申请日:2021-06-08
Applicant: Snap Inc.
Inventor: Jia Li , Nathan Litke , Jose Jesus (Joseph) Paredes , Rahul Bhupendra Sheth , Daniel Szeto , Ning Xu , Jianchao Yang
IPC: G11B27/10 , G11B27/031
Abstract: Systems and methods are described for determining a first media item related to an event, of a plurality of stored media items each comprising video content related to the event, that was captured in a device orientation corresponding to a first device orientation detected for the first computing device; providing, to the first computing device, the first media item to be displayed on the first computing device; in response to a detected change to a second device orientation for the first computing device, determining a second media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and providing, to the first computing device, the second media item to be displayed on the first computing device.
-
公开(公告)号:US11122218B2
公开(公告)日:2021-09-14
申请号:US16722721
申请日:2019-12-20
Applicant: Snap Inc.
Inventor: Jia Li , Nathan Litke , Jose Jesus (Joseph) Paredes , Rahul Bhupendra Sheth , Daniel Szeto , Ning Xu , Jianchao Yang
Abstract: Systems and methods are described for determining that the user interaction with a display of a computing device during display of a video comprising a sequence of frames indicates a region of interest in a current frame of the sequence of frames of the displayed video. For each frame of the sequence of frames after the current frame, the frame is cropped to generate a cropped frame comprising a portion of the frame including the region of interest in the frame, the cropped frame is enlarged based on a display size corresponding to an angle or orientation of the computing device during display of the video, and the enlarged cropped frame replaces the frame such that the enlarged cropped frame is displayed in the sequence of frames of the video on the display of the computing device instead of the frame.
-
公开(公告)号:US11100311B2
公开(公告)日:2021-08-24
申请号:US16509083
申请日:2019-07-11
Applicant: Snap Inc.
Inventor: Jia Li , Xutao Lv , Xiaoyu Wang , Xuehan Xiong , Jianchao Yang
Abstract: Systems, devices, media, and methods are presented for modeling facial representations using image segmentation with a client device. The systems and methods receive an image depicting a face, detect at least a portion of the face within the image, and identify a set of facial features within the portion of the face. The systems and methods generate a descriptor function representing the set of facial features, fit object functions of the descriptor function, identify an identification probability for each facial feature, and assign an identification to each facial feature.
-
-
-
-
-
-
-
-
-