-
公开(公告)号:US20200219312A1
公开(公告)日:2020-07-09
申请号:US16824297
申请日:2020-03-19
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M. Rodriguez, II , Rahul Sheth , Jia Li , Xutao Lv
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. Point cloud data describing an environment is then accessed. A two-dimensional surface of an image of an environment is captured, and a portion of the image is matched to a portion of key points in the point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.
-
公开(公告)号:US10657708B1
公开(公告)日:2020-05-19
申请号:US15971566
申请日:2018-05-04
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M Rodriguez, II , Rahul Sheth , Jia Li , Xutao Lv
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A 3D point cloud data describing an environment is then accessed. A first image of an environment is captured, and a portion of the image is matched to a portion of key points in the 3D point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the 3D point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.
-
公开(公告)号:US20170243371A1
公开(公告)日:2017-08-24
申请号:US15591887
申请日:2017-05-10
Applicant: SNAP INC.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M. Rodriguez, II , Rahul Sheth , Jia Li , Xutao Lv
CPC classification number: G06T19/006 , G06F3/012 , G06F3/04815 , G06K9/00624 , G06K9/00664 , G06K9/00671 , G06K9/78 , G06K2209/21 , G06T7/20 , G06T7/246 , G06T7/73 , G06T13/80 , G06T19/20 , G06T2200/04 , G06T2207/30244 , G06T2219/2004
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure facades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.
-
公开(公告)号:US11341177B1
公开(公告)日:2022-05-24
申请号:US16722776
申请日:2019-12-20
Applicant: Snap Inc.
Inventor: Zhou Ren , Xiaoyu Wang , Ning Zhang , Xutao Lv , Jia Li
IPC: G06K9/00 , G06F16/338 , G06F16/33 , G06V10/44 , G06V10/94 , G06V10/70 , G06V30/194 , G06N5/02
Abstract: An image captioning system and method is provided for generating a caption for an image. The image captioning system utilizes a policy network and a value network to generate the caption. The policy network serves as a local guidance and the value network serves as a global and lookahead guidance.
-
公开(公告)号:US20210174578A1
公开(公告)日:2021-06-10
申请号:US17248833
申请日:2021-02-10
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M Rodriguez, II , Rahul Sheth , Jia Li , Xutao Lv
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. Point cloud data describing an environment is then accessed. A two-dimensional surface of an image of an environment is captured, and a portion of the image is matched to a portion of key points in the point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.
-
公开(公告)号:US10733802B2
公开(公告)日:2020-08-04
申请号:US16438226
申请日:2019-06-11
Applicant: Snap Inc
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M Rodriguez, II , Rahul Sheth , Jia Li , Xutao Lv
IPC: G06T19/00 , G06T7/73 , G06F3/01 , G06F3/0481 , G06K9/00 , G06K9/78 , G06T7/20 , G06T13/80 , G06T19/20 , G06T7/246
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.
-
公开(公告)号:US20190332852A1
公开(公告)日:2019-10-31
申请号:US16509083
申请日:2019-07-11
Applicant: Snap Inc.
Inventor: Jia Li , Xutao Lv , Xiaoyu Wang , Xuehan Xiong , Jiancho Yang
Abstract: Systems, devices, media, and methods are presented for modeling facial representations using image segmentation with a client device. The systems and methods receive an image depicting a face, detect at least a portion of the face within the image, and identify a set of facial features within the portion of the face. The systems and methods generate a descriptor function representing the set of facial features, fit object functions of the descriptor function, identify an identification probability for each facial feature, and assign an identification to each facial feature.
-
公开(公告)号:US20180089904A1
公开(公告)日:2018-03-29
申请号:US15830965
申请日:2017-12-04
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M. Rodriguez, II , Rahul Bhupendra Sheth , Jia Li , Xutao Lv
IPC: G06T19/00 , G06T7/20 , G06T13/80 , G06F3/0481 , G06T19/20 , G06T7/73 , G06F3/01 , G06K9/00 , G06K9/78 , G06T7/246
CPC classification number: G06T19/006 , G06F3/012 , G06F3/04815 , G06K9/00624 , G06K9/00664 , G06K9/00671 , G06K9/78 , G06K2209/21 , G06T7/20 , G06T7/246 , G06T7/73 , G06T13/80 , G06T19/20 , G06T2200/04 , G06T2207/30244 , G06T2219/2004
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.
-
公开(公告)号:US12079931B2
公开(公告)日:2024-09-03
申请号:US17856720
申请日:2022-07-01
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M Rodriguez, II , Rahul Bhupendra Sheth , Jia Li , Xutao Lv
CPC classification number: G06T17/00 , G06T19/006 , G06T2210/56
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. Point cloud data describing an environment is then accessed. A two-dimensional surface of an image of an environment is captured, and a portion of the image is matched to a portion of key points in the point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.
-
公开(公告)号:US11380051B2
公开(公告)日:2022-07-05
申请号:US17248833
申请日:2021-02-10
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M Rodriguez, II , Rahul Sheth , Jia Li , Xutao Lv
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. Point cloud data describing an environment is then accessed. A two-dimensional surface of an image of an environment is captured, and a portion of the image is matched to a portion of key points in the point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.
-
-
-
-
-
-
-
-
-