公开(公告)号：US12190457B2

公开(公告)日：2025-01-07

申请号：US17893738

申请日：2022-08-23

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll ,  Tomasz Zakrzewski

IPC: G06T7/73 ,  G06F3/01 ,  G06T19/00 ,  G06V20/52 ,  G06V20/68

Abstract: Systems, methods, and computer readable media for object counting on augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable display of a count of objects as part of a user view. Upon receipt of a request to count objects, the AR wearable device captures an image of the user view. The AR wearable device transmits the image to a backend for processing to determine the objects in the image. The AR wearable device selects a group of objects of the determined objects to count and overlays boundary boxes over counted objects within the user view. The position of the boundary boxes is adjusted to account for movement of the AR wearable device. A hierarchy of objects is used to group together objects that are related but have different labels or names.

公开(公告)号：US20240114219A1

公开(公告)日：2024-04-04

申请号：US17956603

申请日：2022-09-29

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul ,  Dawei Zhang

IPC: H04N21/8545 ,  G06F3/04817 ,  G06K19/06

CPC classification number: H04N21/8545 ,  G06F3/04817 ,  G06K19/06037

Abstract: A mixed-reality media content system may be configured to perform operations that include: causing display of image data at a client device, the image data comprising a depiction of an object that includes a graphical code at a position upon the object; detecting the graphical code at the position upon the depiction of the object based on the image data; accessing media content within a media repository based on the graphical code scanned by the client device; and causing display of a presentation of the media content at the position of the graphical code upon the depiction of the object at the client device.

公开(公告)号：US11922096B1

公开(公告)日：2024-03-05

申请号：US17823169

申请日：2022-08-30

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul

IPC: G06F3/16 ,  G06F3/04817 ,  G06F3/0484 ,  G10L15/16 ,  G10L15/22

CPC classification number: G06F3/167 ,  G06F3/04817 ,  G06F3/0484 ,  G10L15/16 ,  G10L15/22 ,  G10L2015/223

Abstract: Systems, methods, and computer readable media for voice-controlled user interfaces (UIs) for augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable a user to interact with the AR wearable device without using physical user interface devices. An application has a non-voice-controlled UI mode and a voice-controlled UI mode. The user selects the mode of the UI. The application running on the AR wearable device displays UI elements on a display of the AR wearable device. The UI elements have types. Predetermined actions are associated with each of the UI element types. The predetermined actions are displayed with other information and used by the user to invoke the corresponding UI element.

公开(公告)号：US20230394770A1

公开(公告)日：2023-12-07

申请号：US17830708

申请日：2022-06-02

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll

IPC: G06T19/00 ,  G06F3/01 ,  G06F1/16 ,  G06V10/82 ,  G06K19/077

CPC classification number: G06T19/006 ,  G06F3/011 ,  G06F1/163 ,  G06V10/82 ,  G06K19/07758

Abstract: Systems, methods, and computer readable media for input modalities for an augmented reality (AR) wearable device are disclosed. The AR wearable device captures images using an image capturing device and processes the images to identify objects. The objects may be people, places, things, and so forth. The AR wearable device associates the objects with tags such as the name of the object or a function that can be provided by the selection of the object. The AR wearable device then matches the tags of the objects with tags associated with AR applications. The AR wearable device presents on a display of the AR wearable device indications of the AR applications with matching tags, which provides a user with the opportunity to invoke one of the AR applications. The AR wearable device recognizes a selection of an AR application in a number of different ways including gesture recognition and voice commands.

公开(公告)号：US20240134724A1

公开(公告)日：2024-04-25

申请号：US18049174

申请日：2022-10-23

Applicant: Snap Inc.

Inventor： Adithya Gajulapally ,  Piotr Gurgul ,  Andrew Ly ,  Sharon Moll

IPC: G06F9/54 ,  H04L67/133

CPC classification number: G06F9/547 ,  H04L67/133

Abstract: Systems, methods, and computer readable media for a service manger to manage services on a wearable device are disclosed. The service manager remains active in memory and listens for requests for services. The service manager then determines which services to run and which to stop to respond to the requests for services. After running a service, the service manager calls the service to respond to the request and sends a response to the request to the sender of the request. The service manager may be resident on a different processor than a processor from which the requests for services originate. The service manager maintains priorities of the services to determine which services to stop or remove from memory.

公开(公告)号：US20240126502A1

公开(公告)日：2024-04-18

申请号：US18397786

申请日：2023-12-27

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul

IPC: G06F3/16 ,  G06F3/04817 ,  G06F3/0484 ,  G10L15/16 ,  G10L15/22

CPC classification number: G06F3/167 ,  G06F3/04817 ,  G06F3/0484 ,  G10L15/16 ,  G10L15/22 ,  G10L2015/223

Abstract: Systems, methods, and computer readable media for voice-controlled user interfaces (UIs) for augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable a user to interact with the AR wearable device without using physical user interface devices. An application has a non-voice-controlled UI mode and a voice-controlled UI mode. The user selects the mode of the UI. The application running on the AR wearable device displays UI elements on a display of the AR wearable device. The UI elements have types. Predetermined actions are associated with each of the UI element types. The predetermined actions are displayed with other information and used by the user to invoke the corresponding UI element.

公开(公告)号：US20240029370A1

公开(公告)日：2024-01-25

申请号：US18374519

申请日：2023-09-28

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Tomasz Zakrzewski

IPC: G06T19/00 ,  H04W4/80 ,  G06F3/01

CPC classification number: G06T19/006 ,  H04W4/80 ,  G06F3/017

Abstract: Systems, methods, and computer readable media for enhanced augmented reality (AR) reading are provided, where the methods include entering a reading mode, capturing an image of a section of reading materials such as a page of a book, identifying a code within the image, and identifying a code module corresponding to the code. The methods further include executing the code module, the code module providing an augmented reality object or virtual reality object related to an object depicted on the section or page, entering a sleep mode for a sleep duration based on an estimated reading time duration of a section or page, awaking after the sleep duration, and capturing a next image. The sleep duration is adjusted based on times when identifiers of the sections of the reading materials such as numbers are captured. The user may manually wake the AR reading device using an external user interface.

公开(公告)号：US11601888B2

公开(公告)日：2023-03-07

申请号：US17444111

申请日：2021-07-30

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Lucas Rangit Magasweran

IPC: H04W52/26 ,  H04W52/02 ,  G06T13/00 ,  G06T11/00 ,  G01S5/02 ,  G01S5/00 ,  H04W64/00 ,  G01S19/48

Abstract: Systems, methods, and computer readable media that determine a location of a device using multi-source geolocation data, where the methods include accessing new location data from a location source of a plurality of location sources, where the new location data includes a new position and an accuracy of the new position, and determining a current position and an accuracy of the current position based on the new position, the accuracy of the new position, an previous current position, and an accuracy of the previous current position. The method further includes determining a change in location based on a difference between the current position and the previous current position. Some systems, methods, and computer readable media are directed to scheduling location requests to generate location data where the scheduling and the actual requests are made based on a number of conditions.

公开(公告)号：US12212820B2

公开(公告)日：2025-01-28

申请号：US18440603

申请日：2024-02-13

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul ,  Dawei Zhang

IPC: H04N21/8545 ,  G06F3/04817 ,  G06K19/06

Abstract: A mixed-reality media content system may be configured to perform operations that include: causing display of image data at a client device, the image data comprising a depiction of an object that includes a graphical code at a position upon the object; detecting the graphical code at the position upon the depiction of the object based on the image data; accessing media content within a media repository based on the graphical code scanned by the client device; and causing display of a presentation of the media content at the position of the graphical code upon the depiction of the object at the client device.

公开(公告)号：US20240264452A1

公开(公告)日：2024-08-08

申请号：US18639566

申请日：2024-04-18

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul ,  Tomasz Zakrzewski

IPC: G02B27/01 ,  G06F3/01 ,  G06F3/16 ,  G06T19/00

CPC classification number: G02B27/0176 ,  G06F3/016 ,  G06F3/167 ,  G06T19/006 ,  G02B2027/0138

Abstract: Systems, methods, and computer readable media for voice input for augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable a user to interact with the AR wearable device without using physical user interface devices. A keyword is used to indicate that the user is about to speak an action or command. The AR wearable device divides the processing of the audio data into a keyword module that is trained to recognize the keyword and a module to process the audio data after the keyword. In some embodiments, the AR wearable device transmits the audio data after the keyword to a host device to process. The AR wearable device maintains an application registry that associates actions with applications. Applications can be downloaded, and the application registry updated where the applications indicate actions to associate with the application.