-
公开(公告)号:US12265664B2
公开(公告)日:2025-04-01
申请号:US18341558
申请日:2023-06-26
Applicant: Snap Inc.
Inventor: Georgios Evangelidis , Bernhard Jung , Ilteris Kaan Canberk , Daniel Wolf , Balázs Tóth , Márton Gergely Kajtár , Branislav Micusik
Abstract: A method for aligning coordinate systems of user devices in an augmented reality system using somatic points of a user's hand as alignment markers. Images captured from multiple user devices are used to align the reference coordinate systems of the user devices to a common reference coordinate system. In some examples, user devices capture images of a hand of a user and use object recognition to identify somatic points as alignment markers. The somatic points of a user device are translated to a common reference coordinate system determined by another user device.
-
公开(公告)号:US20250022162A1
公开(公告)日:2025-01-16
申请号:US18450137
申请日:2023-08-15
Applicant: Snap Inc.
Inventor: Brian Fulkerson , Thomas Muttenthaler , Georgios Papandreou , Daniel Wolf
Abstract: Examples disclosed herein relate to the use of shared pose data in extended reality (XR) tracking. A communication link is established between a first XR device and a second XR device. The second XR device is worn by a user. The first XR device receives pose data of the second XR device via the communication link and captures an image of the user. The user is identified based on the image and the pose data.
-
公开(公告)号:US20240233144A9
公开(公告)日:2024-07-11
申请号:US17973167
申请日:2022-10-25
Applicant: Snap Inc.
Inventor: Branislav Micusik , Georgios Evangelidis , Daniel Wolf
CPC classification number: G06T7/292 , G06F3/011 , G06T7/564 , G06T19/006 , G06V20/64 , G06T2207/10012 , G06T2207/10028 , G06T2210/56
Abstract: A method for carving a 3D space using hands tracking is described. In one aspect, a method includes accessing a first frame from a camera of a display device, tracking, using a hand tracking algorithm operating at the display device, hand pixels corresponding to one or more user hands depicted in the first frame, detecting, using a sensor of the display device, depths of the hand pixels, identifying a 3D region based on the depths of the hand pixels, and applying a 3D reconstruction engine to the 3D region.
-
公开(公告)号:US20230388632A1
公开(公告)日:2023-11-30
申请号:US18233729
申请日:2023-08-14
Applicant: Snap Inc.
Inventor: Bo Ding , Ozi Egri , Matthias Kalkgruber , Daniel Wolf
IPC: H04N23/68
CPC classification number: H04N23/6811 , H04N23/684 , H04N23/6812 , G06T19/006
Abstract: A method for limiting motion blur in a visual tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor for the first image, determining a motion of the optical sensor for the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and adjusting the camera operating parameters of the optical sensor based on the motion blur level.
-
公开(公告)号:US11719939B2
公开(公告)日:2023-08-08
申请号:US17739551
申请日:2022-05-09
Applicant: Snap Inc.
Inventor: Sumant Hanumante , Bernhard Jung , Matthias Kalkgruber , Anton Kondratenko , Edward Lee Kim-Koon , Gerald Nilles , John James Robertson , Dmitry Ryuma , Alexander Sourov , Daniel Wolf
CPC classification number: G02B27/0172 , G01K7/00 , G06F1/26 , G06F3/011 , G06T19/006 , G01K2215/00 , G02B27/0093 , G02B2027/014 , G02B2027/0138 , G02B2027/0178
Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services is provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
-
公开(公告)号:US20230205311A1
公开(公告)日:2023-06-29
申请号:US18116511
申请日:2023-03-02
Applicant: Snap Inc.
Inventor: Georg Halmetschlager-Funek , Matthias kALKGRUBER , Daniel Wolf , Jakob Zillner
IPC: G06F3/01 , G06F3/038 , H04L67/131
CPC classification number: G06F3/012 , G06F3/038 , H04L67/131 , G06F2203/0383
Abstract: A method for calibrating a visual-inertial tracking system is described. A device operates the visual-inertial tracking system without receiving a tracking request from a virtual object display application. In response to operating the visual-inertial tracking system, the device accesses sensor data from sensors at the device. The device identifies, based on the sensor data, a first calibration parameter value of the visual-inertial tracking system and stores the first calibration parameter value. The system detects a tracking request from the virtual object display application. In response to the tracking request, the system accesses the first calibration parameter value and determines a second calibration parameter value from the first calibration parameter value.
-
公开(公告)号:US20220365348A1
公开(公告)日:2022-11-17
申请号:US17739551
申请日:2022-05-09
Applicant: Snap Inc.
Inventor: Sumant Hanumante , Bernhard Jung , Matthias Kalkgruber , Anton Kondratenko , Edward Lee Kim-Koon , Gerald Nilles , John James Robertson , Dmitry Ryuma , Alexander Sourov , Daniel Wolf
Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services is provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
-
公开(公告)号:US12265222B2
公开(公告)日:2025-04-01
申请号:US18368288
申请日:2023-09-14
Applicant: Snap Inc.
Inventor: Olha Borys , Georg Halmetschlager-Funek , Matthias Kalkgruber , Daniel Wolf , Jakob Zillner
IPC: G02B27/01 , G06F1/16 , G06F1/3206 , G06T7/00 , G06T7/50
Abstract: Visual-inertial tracking of an eyewear device using sensors. The eyewear device monitors the sensors of a visual inertial odometry system (VIOS) that provide input for determining a position of the device within its environment. The eyewear device determines the status of the VIOS based information from the sensors and adjusts the plurality of sensors (e.g., by turning on/off sensors, changing the sampling rate, of a combination thereof) based on the determined status. The eyewear device then determines the position of the eyewear device within the environment using the adjusted plurality of sensors.
-
公开(公告)号:US12260567B2
公开(公告)日:2025-03-25
申请号:US17973167
申请日:2022-10-25
Applicant: Snap Inc.
Inventor: Branislav Micusik , Georgios Evangelidis , Daniel Wolf
Abstract: A method for carving a 3D space using hands tracking is described. In one aspect, a method includes accessing a first frame from a camera of a display device, tracking, using a hand tracking algorithm operating at the display device, hand pixels corresponding to one or more user hands depicted in the first frame, detecting, using a sensor of the display device, depths of the hand pixels, identifying a 3D region based on the depths of the hand pixels, and applying a 3D reconstruction engine to the 3D region.
-
30.
公开(公告)号:US12148128B2
公开(公告)日:2024-11-19
申请号:US17521081
申请日:2021-11-08
Applicant: Snap Inc.
Inventor: Olha Borys , Matthias Kalkgruber , Daniel Wolf
Abstract: A method for mitigating motion blur in a visual tracking system is described. In one aspect, a method for selective motion blur mitigation in a visual tracking system includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor during the optical sensor generating the first image, determining a motion of the optical sensor during the optical sensor generating the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and determining whether to downscale the first image using a pyramid computation algorithm based on the motion blur level.
-
-
-
-
-
-
-
-
-