-
公开(公告)号:US12001024B2
公开(公告)日:2024-06-04
申请号:US18299923
申请日:2023-04-13
Applicant: Snap Inc.
Inventor: Jian Wang , Sizhuo Ma , Brevin Tilmon , Yicheng Wu , Gurunandan Krishnan Gorumkonda , Ramzi Zahreddine , Georgios Evangelidis
CPC classification number: G02B27/0172 , G06F3/013 , G06T19/006 , G02B2027/0138
Abstract: An energy-efficient adaptive 3D sensing system. The adaptive 3D sensing system includes one or more cameras and one or more projectors. The adaptive 3D sensing system captures images of a real-world scene using the one or more cameras and computes depth estimates and depth estimate confidence values for pixels of the images. The adaptive 3D sensing system computes an attention mask based on the one or more depth estimate confidence values and commands the one or more projectors to send a distributed laser beam into one or more areas of the real-world scene based on the attention mask. The adaptive 3D sensing system captures 3D sensing image data of the one or more areas of the real-world scene and generates 3D sensing data for the real-world scene based on the 3D sensing image data.
-
公开(公告)号:US20230069614A1
公开(公告)日:2023-03-02
申请号:US17898136
申请日:2022-08-29
Applicant: Snap Inc.
Abstract: Images of a scene are received. The images represent viewpoints corresponding to the scene. A pixel map of the scene is computed based on the plurality of images. Multi-plane image (MPI) layers from the pixel map are extracted in real-time. The MPI layers are aggregated. The scene is rendered from a novel viewpoint based on the aggregated MPI layers.
-
公开(公告)号:US12112427B2
公开(公告)日:2024-10-08
申请号:US17898136
申请日:2022-08-29
Applicant: Snap Inc.
CPC classification number: G06T15/205 , G06T7/55 , G06T15/04 , G06T17/20 , G06T2207/10016 , G06T2207/10024 , G06T2207/10028
Abstract: Images of a scene are received. The images represent viewpoints corresponding to the scene. A pixel map of the scene is computed based on the plurality of images. Multi-plane image (MPI) layers from the pixel map are extracted in real-time. The MPI layers are aggregated. The scene is rendered from a novel viewpoint based on the aggregated MPI layers.
-
公开(公告)号:US20240288696A1
公开(公告)日:2024-08-29
申请号:US18653808
申请日:2024-05-02
Applicant: Snap Inc.
Inventor: Jian Wang , Sizhuo Ma , Brevin Tilmon , Yicheng Wu , Gurunandan Krishnan Gorumkonda , Ramzi Zahreddine , Georgios Evangelidis
CPC classification number: G02B27/0172 , G06F3/013 , G06T19/006 , G02B2027/0138
Abstract: An energy-efficient adaptive 3D sensing system. The adaptive 3D sensing system includes one or more cameras and one or more projectors. The adaptive 3D sensing system captures images of a real-world scene using the one or more cameras and computes depth estimates and depth estimate confidence values for pixels of the images. The adaptive 3D sensing system computes an attention mask based on the one or more depth estimate confidence values and commands the one or more projectors to send a distributed laser beam into one or more areas of the real-world scene based on the attention mask. The adaptive 3D sensing system captures 3D sensing image data of the one or more areas of the real-world scene and generates 3D sensing data for the real-world scene based on the 3D sensing image data.
-
公开(公告)号:US20240126084A1
公开(公告)日:2024-04-18
申请号:US18299923
申请日:2023-04-13
Applicant: Snap Inc.
Inventor: Jian Wang , Sizhuo Ma , Brevin Tilmon , Yicheng Wu , Gurunandan Krishnan Gorumkonda , Ramzi Zahreddine , Georgios Evangelidis
CPC classification number: G02B27/0172 , G06F3/013 , G06T19/006 , G02B2027/0138
Abstract: An energy-efficient adaptive 3D sensing system. The adaptive 3D sensing system includes one or more cameras and one or more projectors. The adaptive 3D sensing system captures images of a real-world scene using the one or more cameras and computes depth estimates and depth estimate confidence values for pixels of the images. The adaptive 3D sensing system computes an attention mask based on the one or more depth estimate confidence values and commands the one or more projectors to send a distributed laser beam into one or more areas of the real-world scene based on the attention mask. The adaptive 3D sensing system captures 3D sensing image data of the one or more areas of the real-world scene and generates 3D sensing data for the real-world scene based on the 3D sensing image data.
-
公开(公告)号:US20230360251A1
公开(公告)日:2023-11-09
申请号:US18144187
申请日:2023-05-06
Applicant: Snap Inc.
Inventor: Gurunandan Krishnan Gorumkonda , Shree K. Nayar , Yicheng Wu
CPC classification number: G06T7/70 , G06V40/161 , G06T2207/30201
Abstract: A device that measures a size of a user's face, referred to as face scaling, using a monocular camera. Depth is calculated from sparse feature points. A face mesh is used to improve the estimation accuracy. A processing pipeline detects face features by applying a face landmark detection algorithm to find the important face feature points such as the eyes, nose, and mouth. The processing pipeline estimates feature points depth using depth obtained through image defocus. The processing pipeline further scales the face using an estimated depth of the face features.
-
-
-
-
-