-
公开(公告)号:US20250068228A1
公开(公告)日:2025-02-27
申请号:US18478853
申请日:2023-09-29
Applicant: Snap Inc.
Inventor: Evangelos Chatzikalymnios , Thomas Faeulhammer , Daniel Wolf , Kai Zhou
IPC: G06F1/3287 , G06V40/10
Abstract: Examples describe a method performed by an extended reality (XR) device that implements a multi-camera object tracking system. The XR device accesses object tracking data associated with an object in a real-world environment. Based on the object tracking data, the XR device activates a low-power mode of the multi-camera object tracking system. In the low-power mode, a state of the object in the real-world environment is determined by using the multi-camera object tracking system.
-
2.
公开(公告)号:US20250037249A1
公开(公告)日:2025-01-30
申请号:US18915975
申请日:2024-10-15
Applicant: Snap Inc.
Inventor: Olha Borys , Matthias Kalkgruber , Daniel Wolf
Abstract: A method for mitigating motion blur in a visual tracking system is described. In one aspect, a method for selective motion blur mitigation in a visual tracking system includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor during the optical sensor generating the first image, determining a motion of the optical sensor during the optical sensor generating the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and determining whether to downscale the first image using a pyramid computation algorithm based on the motion blur level.
-
公开(公告)号:US20250008068A1
公开(公告)日:2025-01-02
申请号:US18883717
申请日:2024-09-12
Applicant: Snap Inc.
Inventor: Olha Borys , Georg Halmetschlager-Funek , Matthias Kalkgruber , Daniel Wolf , Jakob Zillner
IPC: H04N13/128 , G06T7/73 , H04N13/00 , H04N13/239
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for misaligned vantage point mitigation for computer stereo vision. A misaligned vantage point mitigation system determines whether vantage points of the optical sensors are misaligned from an expected vantage point and, if so, determines an adjustment variable to mitigate the misalignment based on the location of matching features identified in images captured by both optical sensors.
-
公开(公告)号:US20240427156A1
公开(公告)日:2024-12-26
申请号:US18826772
申请日:2024-09-06
Applicant: Snap Inc.
Inventor: Sumant Hanumante , Bernhard Jung , Matthias Kalkgruber , Anton Kondratenko , Edward Lee Kim-Koon , Gerald Nilles , John James Robertson , Dmitry Ryuma , Alexander Sourov , Daniel Wolf
Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services it provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
-
公开(公告)号:US20240288946A1
公开(公告)日:2024-08-29
申请号:US18341558
申请日:2023-06-26
Applicant: Snap Inc.
Inventor: Georgios Evangelidis , Bernhard Jung , Ilteris Kaan Canberk , Daniel Wolf , Balázs Töth , Márton Gergely Kajtár , Branislav Micusik
CPC classification number: G06F3/017 , G06F3/012 , G06T7/248 , G06T7/74 , G06T2207/30196 , G06T2207/30204 , G06T2207/30241
Abstract: A method for aligning coordinate systems of user devices in an augmented reality system using somatic points of a user's hand as alignment markers. Images captured from multiple user devices are used to align the reference coordinate systems of the user devices to a common reference coordinate system. In some examples, user devices capture images of a hand of a user and use object recognition to identify somatic points as alignment markers. The somatic points of a user device are translated to a common reference coordinate system determined by another user device.
-
公开(公告)号:US20240135555A1
公开(公告)日:2024-04-25
申请号:US17973167
申请日:2022-10-24
Applicant: Snap Inc.
Inventor: Branislav Micusik , Georgios Evangelidis , Daniel Wolf
CPC classification number: G06T7/292 , G06F3/011 , G06T7/564 , G06T19/006 , G06V20/64 , G06T2207/10012 , G06T2207/10028 , G06T2210/56
Abstract: A method for carving a 3D space using hands tracking is described. In one aspect, a method includes accessing a first frame from a camera of a display device, tracking, using a hand tracking algorithm operating at the display device, hand pixels corresponding to one or more user hands depicted in the first frame, detecting, using a sensor of the display device, depths of the hand pixels, identifying a 3D region based on the depths of the hand pixels, and applying a 3D reconstruction engine to the 3D region.
-
公开(公告)号:US20230350206A1
公开(公告)日:2023-11-02
申请号:US18218905
申请日:2023-07-06
Applicant: Snap Inc.
Inventor: Sumant Hanumante , Bernhard Jung , Matthias Kalkgruber , Anton Kondratenko , Edward Lee Kim-Koon , Gerald Nilles , John James Robertson , Dmitry Ryuma , Alexander Sourov , Daniel Wolf
CPC classification number: G02B27/0172 , G01K7/00 , G06F1/26 , G06F3/011 , G06T19/006 , G01K2215/00 , G02B27/0093
Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services it provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
-
公开(公告)号:US20230300464A1
公开(公告)日:2023-09-21
申请号:US18321565
申请日:2023-05-22
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Daniel Wolf
CPC classification number: H04N23/6811 , G06T5/002 , G06T7/20 , G06T3/40 , G06V10/443 , H04N23/6812
Abstract: A method for mitigating motion blur in a visual-inertial tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, accessing a second image generated by the optical sensor of the visual tracking system, the second image following the first image, determining a first motion blur level of the first image, determining a second motion blur level of the second image, identifying a scale change between the first image and the second image, determining a first optimal scale level for the first image based on the first motion blur level and the scale change, and determining a second optimal scale level for the second image based on the second motion blur level and the scale change.
-
公开(公告)号:US11683585B2
公开(公告)日:2023-06-20
申请号:US17521109
申请日:2021-11-08
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Daniel Wolf
CPC classification number: H04N23/6811 , G06T3/40 , G06T5/002 , G06T7/20 , G06V10/443 , H04N23/6812
Abstract: A method for mitigating motion blur in a visual-inertial tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, accessing a second image generated by the optical sensor of the visual tracking system, the second image following the first image, determining a first motion blur level of the first image, determining a second motion blur level of the second image, identifying a scale change between the first image and the second image, determining a first optimal scale level for the first image based on the first motion blur level and the scale change, and determining a second optimal scale level for the second image based on the second motion blur level and the scale change.
-
公开(公告)号:US20250054176A1
公开(公告)日:2025-02-13
申请号:US18475720
申请日:2023-09-27
Applicant: Snap Inc.
Inventor: Evangelos Chatzikalymnios , Thomas Faeulhammer , Ihor Tymchyshyn , Daniel Wolf
Abstract: A device includes a processor, image sensors, and memory storing instructions to obtain images from the sensors and process a first image to identify coordinates of a bounding box around an object. The device processes the area within the first box to determine 2-D positions of landmarks associated with the object, derives first 3-D positions of the landmarks, and determines coordinates of a second box bounding the object in the second image using the 3-D landmark positions. The device processes the area within the second box to determine 2-D positions of landmarks and uses triangulation to derive second 3-D positions of the landmarks. Overall, the device obtains images, detects objects and landmarks, determines 2-D and 3-D positions of landmarks, and triangulates 3-D positions.
-
-
-
-
-
-
-
-
-