-
公开(公告)号:US20230419621A1
公开(公告)日:2023-12-28
申请号:US18243360
申请日:2023-09-07
Applicant: Snap Inc.
Inventor: Matan Zohar , Yanli Zhao , Brian Fulkerson , Itamar Berger
CPC classification number: G06T19/006 , G06T7/70 , G06V40/10 , G10L15/08 , G10L2015/088
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising receiving an image that depicts a person, identifying a set of skeletal joints of the person and identifying a pose of the person depicted in the image based on positioning of the set of skeletal joints. The operations also include receiving speech input comprising a request to perform an AR operation and an ambiguous intent, discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image and in response to receiving the speech input, performing the AR operation based on discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image.
-
公开(公告)号:US11763481B2
公开(公告)日:2023-09-19
申请号:US17506442
申请日:2021-10-20
Applicant: Snap Inc.
Inventor: Matan Zohar , Yanli Zhao , Brian Fulkerson , Itamar Berger
IPC: G06T7/70 , G06V40/10 , G06F18/24 , G06F18/214 , G06T19/00
CPC classification number: G06T7/70 , G06F18/214 , G06F18/24 , G06T19/006 , G06V40/103 , G06V40/107 , G06T2207/10016 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person. The operations further include identifying a set of skeletal joints of the person. The operations further include identifying a pose of the person depicted in the video based on positioning of the set of skeletal joints (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device). The operations further include determining, based on the pose of the person (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device), that the video comprises a mirror reflection of the person. The operations further include, in response to determining that the video comprises the mirror reflection of the person, causing display of a 3D virtual object in the video.
-
公开(公告)号:US20230177788A1
公开(公告)日:2023-06-08
申请号:US18062393
申请日:2022-12-06
Applicant: Snap Inc.
Inventor: Marwan Aljubeh , Gregory James Bakker , Eric Nersesian , Supannee Tanathong , Yanli Zhao
CPC classification number: G06T19/20 , G06T19/006 , G06T7/70 , G06T2219/2004
Abstract: The present disclosure provides a method for creating a 3D model of a reference surface. The method includes capturing, using a capture device, a plurality of data points on the reference surface, determining a position and an orientation of the capture device related to the capture of the plurality of data points, creating a 3D data representation of the reference surface based on the plurality of data points, creating a location tracking data representation of the reference surface based the plurality of data points on the reference surface and the position and the orientation of the capture device, and creating the 3D model of the reference surface based on the 3D data representation and the location tracking data representation of the reference surface.
-
公开(公告)号:US20230116929A1
公开(公告)日:2023-04-20
申请号:US17506442
申请日:2021-10-20
Applicant: Snap Inc.
Inventor: Matan Zohar , Yanli Zhao , Brian Fulkerson , Itamar Berger
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person. The operations further include identifying a set of skeletal joints of the person. The operations further include identifying a pose of the person depicted in the video based on positioning of the set of skeletal joints (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device). The operations further include determining, based on the pose of the person (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device), that the video comprises a mirror reflection of the person. The operations further include, in response to determining that the video comprises the mirror reflection of the person, causing display of a 3D virtual object in the video.
-
公开(公告)号:US20230111489A1
公开(公告)日:2023-04-13
申请号:US17498510
申请日:2021-10-11
Applicant: Snap Inc.
Inventor: Matan Zohar , Yanli Zhao , Brian Fulkerson , Itamar Berger
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising receiving an image that depicts a person, identifying a set of skeletal joints of the person and identifying a pose of the person depicted in the image based on positioning of the set of skeletal joints. The operations also include receiving speech input comprising a request to perform an AR operation and an ambiguous intent, discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image and in response to receiving the speech input, performing the AR operation based on discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image.
-
-
-
-