-
公开(公告)号:US20240427427A1
公开(公告)日:2024-12-26
申请号:US18829090
申请日:2024-09-09
Applicant: Snap Inc.
Abstract: A system for hand tracking for an Augmented Reality (AR) system. The AR system uses a camera of the AR system to capture tracking video frame data of a hand of a user of the AR system. The AR system generates a skeletal model based on the tracking video frame data and determines a location of the hand of the user based on the skeletal model. The AR system causes a steerable camera of the AR system to focus on the hand of the user.
-
公开(公告)号:US12105891B2
公开(公告)日:2024-10-01
申请号:US18357607
申请日:2023-07-24
Applicant: Snap Inc.
CPC classification number: G06F3/017 , G02B27/017 , G06F3/011 , G06T19/006 , G02B2027/0138 , G02B2027/0178
Abstract: A system for hand tracking for an Augmented Reality (AR) system. The AR system uses a camera of the AR system to capture tracking video frame data of a hand of a user of the AR system. The AR system generates a skeletal model based on the tracking video frame data and determines a location of the hand of the user based on the skeletal model. The AR system causes a steerable camera of the AR system to focus on the hand of the user.
-
公开(公告)号:US12092826B2
公开(公告)日:2024-09-17
申请号:US18128905
申请日:2023-03-30
Applicant: Snap Inc.
Inventor: Branislav Micusik , Georgios Evangelidis , Ramzi Zahreddine
CPC classification number: G02B27/0172 , G09G3/32 , G02B2027/014 , G02B2027/0178 , G09G2360/04
Abstract: An eXtended Reality (XR) display system includes a Light Emitting Diode (LED) display controller, and a Light Emitting Diode (LED) near-eye display element operatively coupled to the LED display driver. The LED near-eye display element includes one or more motors and an LED array operably connected to the one or more motors. During operation, the LED display driver receives video data including a rendered virtual object of an XR experience and generates LED array control signals based on the video data, the LED array control signals causing one or more LEDs of the LED array to be energized in a sequence. The LED display driver also generates synchronized motor control signals and simultaneously communicates the LED array control signals to the LED array and the synchronized motor control signals to the one or more motors causing the LED near-eye display element to display the rendered virtual object.
-
公开(公告)号:US20240288696A1
公开(公告)日:2024-08-29
申请号:US18653808
申请日:2024-05-02
Applicant: Snap Inc.
Inventor: Jian Wang , Sizhuo Ma , Brevin Tilmon , Yicheng Wu , Gurunandan Krishnan Gorumkonda , Ramzi Zahreddine , Georgios Evangelidis
CPC classification number: G02B27/0172 , G06F3/013 , G06T19/006 , G02B2027/0138
Abstract: An energy-efficient adaptive 3D sensing system. The adaptive 3D sensing system includes one or more cameras and one or more projectors. The adaptive 3D sensing system captures images of a real-world scene using the one or more cameras and computes depth estimates and depth estimate confidence values for pixels of the images. The adaptive 3D sensing system computes an attention mask based on the one or more depth estimate confidence values and commands the one or more projectors to send a distributed laser beam into one or more areas of the real-world scene based on the attention mask. The adaptive 3D sensing system captures 3D sensing image data of the one or more areas of the real-world scene and generates 3D sensing data for the real-world scene based on the 3D sensing image data.
-
公开(公告)号:US11988833B2
公开(公告)日:2024-05-21
申请号:US17937950
申请日:2022-10-04
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Tiago Miguel Pereira Torres , Weston Welge , Ramzi Zahreddine
CPC classification number: G02B27/017 , G02B27/0093 , G06T19/006 , G02B2027/0178
Abstract: A system for deformation or bending correction in an Augmented Reality (AR) system. Sensors are positioned in a frame of a head-worn AR system to sense forces or pressure acting on the frame by temple pieces attached to the frame. The sensed forces or pressure are used in conjunction with a model of the frame to determine a corrected model of the frame. The corrected model is used to correct video data captured by the AR system and to correct a video virtual overlay that is provided to a user wearing the head-worn AR system.
-
公开(公告)号:US20240126084A1
公开(公告)日:2024-04-18
申请号:US18299923
申请日:2023-04-13
Applicant: Snap Inc.
Inventor: Jian Wang , Sizhuo Ma , Brevin Tilmon , Yicheng Wu , Gurunandan Krishnan Gorumkonda , Ramzi Zahreddine , Georgios Evangelidis
CPC classification number: G02B27/0172 , G06F3/013 , G06T19/006 , G02B2027/0138
Abstract: An energy-efficient adaptive 3D sensing system. The adaptive 3D sensing system includes one or more cameras and one or more projectors. The adaptive 3D sensing system captures images of a real-world scene using the one or more cameras and computes depth estimates and depth estimate confidence values for pixels of the images. The adaptive 3D sensing system computes an attention mask based on the one or more depth estimate confidence values and commands the one or more projectors to send a distributed laser beam into one or more areas of the real-world scene based on the attention mask. The adaptive 3D sensing system captures 3D sensing image data of the one or more areas of the real-world scene and generates 3D sensing data for the real-world scene based on the 3D sensing image data.
-
公开(公告)号:US11747912B1
公开(公告)日:2023-09-05
申请号:US17950825
申请日:2022-09-22
Applicant: Snap Inc.
CPC classification number: G06F3/017 , G02B27/017 , G06F3/011 , G06T19/006 , G02B2027/0138 , G02B2027/0178
Abstract: A system for hand tracking for an Augmented Reality (AR) system. The AR system uses a camera of the AR system to capture tracking video frame data of a hand of a user of the AR system. The AR system generates a skeletal model based on the tracking video frame data and determines a location of the hand of the user based on the skeletal model. The AR system causes a steerable camera of the AR system to focus on the hand of the user.
-
公开(公告)号:US20240280814A1
公开(公告)日:2024-08-22
申请号:US18643790
申请日:2024-04-23
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Tiago Miguel Pereira Torres , Weston Welge , Ramzi Zahreddine
CPC classification number: G02B27/017 , G02B27/0093 , G06T19/006 , G02B2027/0178
Abstract: A system for deformation or bending correction in an Augmented Reality (AR) system. Sensors are positioned in a frame of a head-worn AR system to sense forces or pressure acting on the frame by temple pieces attached to the frame. The sensed forces or pressure are used in conjunction with a model of the frame to determine a corrected model of the frame. The corrected model is used to correct video data captured by the AR system and to correct a video virtual overlay that is provided to a user wearing the head-worn AR system.
-
公开(公告)号:US12001024B2
公开(公告)日:2024-06-04
申请号:US18299923
申请日:2023-04-13
Applicant: Snap Inc.
Inventor: Jian Wang , Sizhuo Ma , Brevin Tilmon , Yicheng Wu , Gurunandan Krishnan Gorumkonda , Ramzi Zahreddine , Georgios Evangelidis
CPC classification number: G02B27/0172 , G06F3/013 , G06T19/006 , G02B2027/0138
Abstract: An energy-efficient adaptive 3D sensing system. The adaptive 3D sensing system includes one or more cameras and one or more projectors. The adaptive 3D sensing system captures images of a real-world scene using the one or more cameras and computes depth estimates and depth estimate confidence values for pixels of the images. The adaptive 3D sensing system computes an attention mask based on the one or more depth estimate confidence values and commands the one or more projectors to send a distributed laser beam into one or more areas of the real-world scene based on the attention mask. The adaptive 3D sensing system captures 3D sensing image data of the one or more areas of the real-world scene and generates 3D sensing data for the real-world scene based on the 3D sensing image data.
-
公开(公告)号:US20240111156A1
公开(公告)日:2024-04-04
申请号:US17937950
申请日:2022-10-04
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Tiago Miguel Pereira Torres , Weston Welge , Ramzi Zahreddine
CPC classification number: G02B27/017 , G02B27/0093 , G06T19/006 , G02B2027/0178
Abstract: A system for deformation or bending correction in an Augmented Reality (AR) system. Sensors are positioned in a frame of a head-worn AR system to sense forces or pressure acting on the frame by temple pieces attached to the frame. The sensed forces or pressure are used in conjunction with a model of the frame to determine a corrected model of the frame. The corrected model is used to correct video data captured by the AR system and to correct a video virtual overlay that is provided to a user wearing the head-worn AR system.
-
-
-
-
-
-
-
-
-