-
公开(公告)号：US11734844B2
公开(公告)日：2023-08-22
申请号：US17823764
申请日：2022-08-31
Applicant: Snap Inc.
Inventor： Liuhao Ge , Zhou Ren , Yuncheng Li , Zehao Xue , Yingying Wang
CPC classification number: G06T7/50 , G06N3/045 , G06N3/08 , G06T7/75 , G06T17/20 , G06V10/774 , G06V10/82 , G06V40/107 , G06T2207/10004
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for receiving a monocular image that includes a depiction of a hand and extracting features of the monocular image using a plurality of machine learning techniques. The program and method further include modeling, based on the extracted features, a pose of the hand depicted in the monocular image by adjusting skeletal joint positions of a three-dimensional (3D) hand mesh using a trained graph convolutional neural network (CNN); modeling, based on the extracted features, a shape of the hand in the monocular image by adjusting blend shape values of the 3D hand mesh representing surface features of the hand depicted in the monocular image using the trained graph CNN; and generating, for display, the 3D hand mesh adjusted to model the pose and shape of the hand depicted in the monocular image.
-
公开(公告)号：US11727710B2
公开(公告)日：2023-08-15
申请号：US17508384
申请日：2021-10-22
Applicant: Snap Inc.
Inventor： Yuncheng Li , Linjie Yang , Ning Zhang , Zhengyuan Yang
CPC classification number: G06V40/107 , G06F17/15 , G06N3/04 , G06T7/136
Abstract: Segmentation of an image into individual body parts is performed based on a trained model. The model is trained with a plurality of training images, each training image representing a corresponding training figure. The model is also trained with a corresponding plurality of segmentations of the training figures. Each segmentation is generated by positioning body parts between defined positions of joints of the represented figure. The body parts are represented by body part templates obtained from a template library, with the templates defining characteristics of body parts represented by the templates.
-
公开(公告)号：US20230146563A1
公开(公告)日：2023-05-11
申请号：US18150001
申请日：2023-01-04
Applicant: Snap Inc.
Inventor： Harsh Agrawal , Xuan Huang , Jung Hyun Kim , Yuncheng Li , Yiwei Ma , Tao Ning , Ye Tao
IPC: H04L51/52 , G06T7/00 , G06F3/0482 , H04L65/1069 , H04L51/222 , H04L67/01 , G06F18/00
CPC classification number: H04L51/52 , G06F3/0482 , G06F18/00 , G06T7/0002 , H04L51/222 , H04L65/1069 , H04L67/01 , G06T2207/30168 , G06V2201/09
Abstract: Systems, methods, devices, computer readable instruction media, and other embodiments are described for automated image processing and insight presentation. One embodiment involves receiving a plurality of ephemeral content messages from a plurality of client devices, and processing the messages to identify content associated with at least a first content type. A set of analysis data associated with the first content type is then generated from the messages, and portions of the messages associated with the first content type are processed to generate a first content collection. The first content collection and the set of analysis data are then communicated to a client device configured for a display interface comprising the first content collection and a representation of at least a portion of the set of analysis data.
-
公开(公告)号：US11551374B2
公开(公告)日：2023-01-10
申请号：US17015819
申请日：2020-09-09
Applicant: Snap Inc.
Inventor： Yuncheng Li , Jonathan M. Rodriguez, II , Zehao Xue , Yingying Wang
Abstract: Systems and methods herein describe using a neural network to identify a first set of joint location coordinates and a second set of joint location coordinates and identifying a three-dimensional hand pose based on both the first and second sets of joint location coordinates.
-
公开(公告)号：US11410439B2
公开(公告)日：2022-08-09
申请号：US16870138
申请日：2020-05-08
Applicant: Snap Inc.
Inventor： Yuncheng Li , Zhou Ren , Ning Xu , Enxu Yan , Tan Yu
Abstract: Systems and methods are disclosed for capturing multiple sequences of views of a three-dimensional object using a plurality of virtual cameras. The systems and methods generate aligned sequences from the multiple sequences based on an arrangement of the plurality of virtual cameras in relation to the three-dimensional object. Using a convolutional network, the systems and methods classify the three-dimensional object based on the aligned sequences and identify the three-dimensional object using the classification.
-
Patent Agency Ranking
公开(公告)号：US11315259B2
公开(公告)日：2022-04-26
申请号：US16949594
申请日：2020-11-05
Applicant: Snap Inc.
Inventor： Yuncheng Li , Linjie Luo , Xuecheng Nie , Ning Zhang
Abstract: Systems, devices, media and methods are presented for a human pose tracking framework. The human pose tracking framework may identify a message with video frames, generate, using a composite convolutional neural network, joint data representing joint locations of a human depicted in the video frames, the generating of the joint data by the composite convolutional neural network done by a deep convolutional neural network operating on one portion of the video frames, a shallow convolutional neural network operating on a another portion of the video frames, and tracking the joint locations using a one-shot learner neural network that is trained to track the joint locations based on a concatenation of feature maps and a convolutional pose machine. The human pose tracking framework may store, the joint locations, and cause presentation of a rendition of the joint locations on a user interface of a client device.
-
公开(公告)号：US11288879B2
公开(公告)日：2022-03-29
申请号：US15929374
申请日：2020-04-29
Applicant: Snap Inc.
Inventor： Travis Chen , Samuel Edward Hare , Yuncheng Li , Tony Mathew , Jonathan Solichin , Jianchao Yang , Ning Zhang
Abstract: Systems, devices, media, and methods are presented for object detection and inserting graphical elements into an image stream in response to detecting the object. The systems and methods detect an object of interest in received frames of a video stream. The systems and methods identify a bounding box for the object of interest and estimate a three-dimensional position of the object of interest based on a scale of the object of interest. The systems and methods generate one or more graphical elements having a size based on the scale of the object of interest and a position based on the three-dimensional position estimated for the object of interest. The one or more graphical elements are generated within the video stream to form a modified video stream. The systems and methods cause presentation of the modified video stream including the object of interest and the one or more graphical elements.
-
公开(公告)号：US20210407548A1
公开(公告)日：2021-12-30
申请号：US17465001
申请日：2021-09-02
Applicant: Snap Inc.
Inventor： Zhou Ren , Yuncheng Li , Ning Xu , Enxu Yan , Tan Yu
Abstract: Aspects of the present disclosure involve a system comprising a storage medium storing a program and method for receiving a video comprising a plurality of video segments; selecting a target action sequence that includes a sequence of action phases; receiving features of each of the video segments; computing, based on the received features, for each of the plurality of video segments, a plurality of action phase confidence scores indicating a likelihood that a given video segment includes a given action phase of the sequence of action phases; identifying a set of consecutive video segments of the plurality of video segments that corresponds to the target action sequence, wherein video segments in the set of consecutive video segments are arranged according to the sequence of action phases; and generating a display of the video that includes the set of consecutive video segments and skips other video segments in the video.
-
公开(公告)号：US10997787B2
公开(公告)日：2021-05-04
申请号：US17010256
申请日：2020-09-02
Applicant: Snap Inc.
Inventor： Liuhao Ge , Zhou Ren , Yuncheng Li , Zehao Xue , Yingying Wang
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for receiving a monocular image that includes a depiction of a hand and extracting features of the monocular image using a plurality of machine learning techniques. The program and method further include modeling, based on the extracted features, a pose of the hand depicted in the monocular image by adjusting skeletal joint positions of a three-dimensional (3D) hand mesh using a trained graph convolutional neural network (CNN); modeling, based on the extracted features, a shape of the hand in the monocular image by adjusting blend shape values of the 3D hand mesh representing surface features of the hand depicted in the monocular image using the trained graph CNN; and generating, for display, the 3D hand mesh adjusted to model the pose and shape of the hand depicted in the monocular image.
-
公开(公告)号：US10984575B2
公开(公告)日：2021-04-20
申请号：US16269312
申请日：2019-02-06
Applicant: Snap Inc.
Inventor： Avihay Assouline , Itamar Berger , Yuncheng Li
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the monocular image; and determining a pose represented by the body depicted in the monocular image based on the detected plurality of skeletal joints of the body. A pose of an avatar is modified to match the pose represented by the body depicted in the monocular image by adjusting a set of skeletal joints of a rig of an avatar based on the detected plurality of skeletal joints of the body; and the avatar having the modified pose that matches the pose represented by the body depicted in the monocular image is generated for display.
-
-
-
-
-
-
-
-
-
Search Results
52
records
(took 0.026 seconds)
