公开(公告)号：US20240096031A1

公开(公告)日：2024-03-21

申请号：US17947889

申请日：2022-09-19

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll

IPC: G06T19/00 ,  G02B27/01 ,  G06T7/70 ,  G06T19/20 ,  G06V10/74 ,  G06V20/20

CPC classification number: G06T19/006 ,  G02B27/0172 ,  G06T7/70 ,  G06T19/20 ,  G06V10/761 ,  G06V20/20 ,  G02B2027/0178 ,  G06T2219/2004 ,  G06T2219/2016

Abstract: Systems, methods, and computer readable media for graphical assistance with tasks using an augmented reality (AR) wearable devices are disclosed. Embodiments capture an image of a first user view of a real-world scene and access indications of surfaces and locations of the surfaces detected in the image. The AR wearable device displays indications of the surfaces on a display of the AR wearable device where the locations of the indications are based on the locations of the surfaces and a second user view of the real-world scene. The locations of the surfaces are indicated with 3D world coordinates. The user views are determined based on a location of the user. The AR wearable device enables a user to add graphics to the surfaces and select tasks to perform. Tools such as a bubble level or a measuring tool are available for the user to utilize to perform the task.

公开(公告)号：US20240069856A1

公开(公告)日：2024-02-29

申请号：US17823169

申请日：2022-08-30

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul

IPC: G06F3/16 ,  G06F3/04817 ,  G06F3/0484 ,  G10L15/16 ,  G10L15/22

CPC classification number: G06F3/167 ,  G06F3/04817 ,  G06F3/0484 ,  G10L15/16 ,  G10L15/22 ,  G10L2015/223

Abstract: Systems, methods, and computer readable media for voice-controlled user interfaces (UIs) for augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable a user to interact with the AR wearable device without using physical user interface devices. An application has a non-voice-controlled UI mode and a voice-controlled UI mode. The user selects the mode of the UI. The application running on the AR wearable device displays UI elements on a display of the AR wearable device. The UI elements have types. Predetermined actions are associated with each of the UI element types. The predetermined actions are displayed with other information and used by the user to invoke the corresponding UI element.

公开(公告)号：US11902902B2

公开(公告)日：2024-02-13

申请号：US18167432

申请日：2023-02-10

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Lucas Rangit Magasweran

IPC: H04W52/02 ,  G06T13/00 ,  G06T11/00 ,  G01S5/02 ,  G01S5/00 ,  H04W64/00 ,  G01S19/48

CPC classification number: H04W52/0261 ,  G01S5/0063 ,  G01S5/0252 ,  G01S5/02685 ,  G06T11/00 ,  G06T13/00 ,  H04W64/003 ,  G01S19/48

Abstract: Systems, methods, and computer readable media that schedules requests for location data of a mobile device, where the methods include selecting a first positioning system based on a power requirement, a latency requirement, and an accuracy requirement, and determining whether a first condition is satisfied for querying the first positioning system. The method further comprises in response to a determination that the first condition is satisfied, querying the first positioning system for first position data. The method further comprises in response to a determination that the first condition is not satisfied, selecting a second positioning system based on the power requirement, the latency requirement, and the accuracy requirement, determining whether a second condition is satisfied for querying the second positioning system, and in response to a determination that the second condition is satisfied, querying the second positioning system for second position data.

公开(公告)号：US11861801B2

公开(公告)日：2024-01-02

申请号：US17651147

申请日：2022-02-15

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Tomasz Zakrzewski

IPC: G06T19/00 ,  H04W4/80 ,  G06F3/01

CPC classification number: G06T19/006 ,  G06F3/017 ,  H04W4/80

Abstract: Systems, methods, and computer readable media for enhanced augmented reality (AR) reading are provided, where the methods include entering a reading mode, capturing an image of a section of reading materials such as a page of a book, identifying a code within the image, and identifying a code module corresponding to the code. The methods further include executing the code module, the code module providing an augmented reality object or virtual reality object related to an object depicted on the section or page, entering a sleep mode for a sleep duration based on an estimated reading time duration of a section or page, awaking after the sleep duration, and capturing a next image. The sleep duration is adjusted based on times when identifiers of the sections of the reading materials such as numbers are captured. The user may manually wake the AR reading device using an external user interface.

公开(公告)号：US12262326B2

公开(公告)日：2025-03-25

申请号：US18166279

申请日：2023-02-08

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Lucas Rangit Magasweran

IPC: H04W52/02 ,  G01S5/00 ,  G01S5/02 ,  G01S19/48 ,  G06T11/00 ,  G06T13/00 ,  H04W64/00

Abstract: Systems, methods, and computer readable media that determine a location of a device using multi-source geolocation data, where the methods include accessing new location data from a location source of a plurality of location sources, where the new location data includes a new position and an accuracy of the new position, and determining a current position and an accuracy of the current position based on the new position, the accuracy of the new position, an previous current position, and an accuracy of the previous current position. The method further includes determining a change in location based on a difference between the current position and the previous current position. Some systems, methods, and computer readable media are directed to scheduling location requests to generate location data where the scheduling and the actual requests are made based on a number of conditions.

公开(公告)号：US20250097548A1

公开(公告)日：2025-03-20

申请号：US18970441

申请日：2024-12-05

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul ,  Dawei Zhang

IPC: H04N21/8545 ,  G06F3/04817 ,  G06K19/06

Abstract: A mixed-reality media content system may be configured to perform operations that include: causing display of image data at a client device, the image data comprising a depiction of an object that includes a graphical code at a position upon the object; detecting the graphical code at the position upon the depiction of the object based on the image data; accessing media content within a media repository based on the graphical code scanned by the client device; and causing display of a presentation of the media content at the position of the graphical code upon the depiction of the object at the client device.

公开(公告)号：US20240411629A1

公开(公告)日：2024-12-12

申请号：US18810020

申请日：2024-08-20

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll

IPC: G06F9/54 ,  G06T19/00

Abstract: Systems, methods, and computer readable media are described for remotely changing settings on augmented reality (AR) wearable devices. Embodiments are disclosed that enable a user to change settings of an AR wearable device on a user interface (UI) provided by a host client device that can communicate wirelessly with the AR wearable device. The host client device and AR wearable device provide remote procedure calls (RPCs) and an application program interface (API) to access settings and determine if settings have been changed. The API enables the host client device to determine the settings on the AR wearable device without any prior knowledge of the settings on the AR wearable device. The RPCs and the API enable the host client device to automatically update the settings on the AR wearable device when the user changes the settings on the host client device.

公开(公告)号：US20240353835A1

公开(公告)日：2024-10-24

申请号：US18136166

申请日：2023-04-18

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll

IPC: G05D1/00 ,  B64U10/14 ,  G05D1/10 ,  G06T7/11 ,  G06T7/60 ,  G06T7/70 ,  G06V20/17 ,  G06V40/10 ,  H04N23/611 ,  H04N23/73

CPC classification number: G05D1/0094 ,  B64U10/14 ,  G06T7/11 ,  G06T7/60 ,  G06T7/70 ,  G06V20/17 ,  G06V40/11 ,  H04N23/611 ,  H04N23/73 ,  B64U2101/30 ,  B64U2201/10 ,  G06T2207/10032

Abstract: Apparatuses, computer readable medium, and methods for image capturing while circumnavigating objects using mobile devices are disclosed. Example methods include capturing an image, processing the image to identify an object within the image, determining a path around the object and a number of images to capture of the object, dividing the path by the number of images to determine a number of waypoints, and navigating the mobile device to the waypoints and capturing an image of the object at each waypoint of the waypoints. Examples include a person pointing at an object and the mobile device identifying the object based on the person pointing at the object. The mobile device determines a bounding box and a geometric center of the bounding box to determine the path to circumnavigate the object. The mobile device determines a height above a ground to assist in navigation.

公开(公告)号：US12086661B2

公开(公告)日：2024-09-10

申请号：US17929985

申请日：2022-09-06

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll

IPC: G06F9/54 ,  G06T19/00

CPC classification number: G06F9/547 ,  G06T19/006

Abstract: Systems, methods, and computer readable media are described for remotely changing settings on augmented reality (AR) wearable devices. Embodiments are disclosed that enable a user to change settings of an AR wearable device on a user interface (UI) provided by a host client device that can communicate wirelessly with the AR wearable device. The host client device and AR wearable device provide remote procedure calls (RPCs) and an application program interface (API) to access settings and determine if settings have been changed. The API enables the host client device to determine the settings on the AR wearable device without any prior knowledge of the settings on the AR wearable device. The RPCs and the API enable the host client device to automatically update the settings on the AR wearable device when the user changes the settings on the host client device.

公开(公告)号：US20240193982A1

公开(公告)日：2024-06-13

申请号：US18063489

申请日：2022-12-08

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll ,  Pawel Wawruch

IPC: G06V40/10 ,  G02B27/01 ,  G06T7/246 ,  G06T7/73 ,  G06V20/20 ,  G06V20/40 ,  H04N23/20

CPC classification number: G06V40/11 ,  G02B27/0101 ,  G02B27/017 ,  G06T7/251 ,  G06T7/75 ,  G06V20/20 ,  G06V20/46 ,  H04N23/20 ,  G02B2027/0138 ,  G02B2027/014 ,  G06T2207/10048 ,  G06T2207/30196

Abstract: An extended Reality (XR) system provides methodologies for capturing hand poses being made by a user in low-light environments. The XR system capture, using one or more visible light cameras, tracking video frame data of a hand pose of a user of the XR system. The XR system generates hand-tracking data based on the tracking video frame data. The hand-tracking data includes a skeletal model and a hand-tracking confidence level indicating a probability that the skeletal model matches the hand pose. The XR system compares the hand-tracking confidence level to a threshold confidence value, and based on determining the first hand-tracking confidence level is below the threshold confidence value, activates one or more wide-spectrum cameras to capture subsequent tracking video frame data of the hand pose. The XR system may also activate an IR light emitter to illuminate the hands of the user.