公开(公告)号：US12190457B2

公开(公告)日：2025-01-07

申请号：US17893738

申请日：2022-08-23

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll ,  Tomasz Zakrzewski

IPC: G06T7/73 ,  G06F3/01 ,  G06T19/00 ,  G06V20/52 ,  G06V20/68

Abstract: Systems, methods, and computer readable media for object counting on augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable display of a count of objects as part of a user view. Upon receipt of a request to count objects, the AR wearable device captures an image of the user view. The AR wearable device transmits the image to a backend for processing to determine the objects in the image. The AR wearable device selects a group of objects of the determined objects to count and overlays boundary boxes over counted objects within the user view. The position of the boundary boxes is adjusted to account for movement of the AR wearable device. A hierarchy of objects is used to group together objects that are related but have different labels or names.

公开(公告)号：US12106580B2

公开(公告)日：2024-10-01

申请号：US17840346

申请日：2022-06-14

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Tomasz Zakrzewski

IPC: G06V20/58 ,  B60W30/18 ,  B60W40/105 ,  G06F1/16

CPC classification number: G06V20/58 ,  B60W30/18109 ,  G06F1/163 ,  B60W40/105 ,  B60W2420/403 ,  B60W2510/18

Abstract: Disclosed is a method of providing a proximity warning using a head-worn device. A distance is determined between the head worn device and a relevant object, such as a cyclist, jogger or vehicle, using image-processing techniques. A speed of the head-worn device is determined using a GPS receiver or other position components located in the head-worn device or an associated user-device. A braking distance for the head-worn device is determined based on the speed of the head-worn device, and compared to the distance to the relevant object. A warning notification is provided by the head-worn device if the distance to the relevant object is less than the braking distance.

公开(公告)号：US20240282058A1

公开(公告)日：2024-08-22

申请号：US18172083

申请日：2023-02-21

Applicant: Snap Inc.

Inventor： Sharon Moll

IPC: G06T19/00 ,  G06F3/04815

CPC classification number: G06T19/006 ,  G06F3/04815

Abstract: An Augmented Reality (AR) graphics system is provided. The AR graphics system may coordinate the display of augmented reality graphics created by multiple users located in an environment. The AR graphics system may determine an alignment object located in the environment that is designated as a common origin of a real-world coordinate system that is used to determine where to display AR graphics within the environment. Additionally, a prioritization scheme is implemented to resolve conflicts between overlapping input provided by different users in order to generate a single version of AR graphics.

公开(公告)号：US20240114219A1

公开(公告)日：2024-04-04

申请号：US17956603

申请日：2022-09-29

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul ,  Dawei Zhang

IPC: H04N21/8545 ,  G06F3/04817 ,  G06K19/06

CPC classification number: H04N21/8545 ,  G06F3/04817 ,  G06K19/06037

Abstract: A mixed-reality media content system may be configured to perform operations that include: causing display of image data at a client device, the image data comprising a depiction of an object that includes a graphical code at a position upon the object; detecting the graphical code at the position upon the depiction of the object based on the image data; accessing media content within a media repository based on the graphical code scanned by the client device; and causing display of a presentation of the media content at the position of the graphical code upon the depiction of the object at the client device.

公开(公告)号：US11922096B1

公开(公告)日：2024-03-05

申请号：US17823169

申请日：2022-08-30

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul

IPC: G06F3/16 ,  G06F3/04817 ,  G06F3/0484 ,  G10L15/16 ,  G10L15/22

CPC classification number: G06F3/167 ,  G06F3/04817 ,  G06F3/0484 ,  G10L15/16 ,  G10L15/22 ,  G10L2015/223

Abstract: Systems, methods, and computer readable media for voice-controlled user interfaces (UIs) for augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable a user to interact with the AR wearable device without using physical user interface devices. An application has a non-voice-controlled UI mode and a voice-controlled UI mode. The user selects the mode of the UI. The application running on the AR wearable device displays UI elements on a display of the AR wearable device. The UI elements have types. Predetermined actions are associated with each of the UI element types. The predetermined actions are displayed with other information and used by the user to invoke the corresponding UI element.

公开(公告)号：US20230394770A1

公开(公告)日：2023-12-07

申请号：US17830708

申请日：2022-06-02

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll

IPC: G06T19/00 ,  G06F3/01 ,  G06F1/16 ,  G06V10/82 ,  G06K19/077

CPC classification number: G06T19/006 ,  G06F3/011 ,  G06F1/163 ,  G06V10/82 ,  G06K19/07758

Abstract: Systems, methods, and computer readable media for input modalities for an augmented reality (AR) wearable device are disclosed. The AR wearable device captures images using an image capturing device and processes the images to identify objects. The objects may be people, places, things, and so forth. The AR wearable device associates the objects with tags such as the name of the object or a function that can be provided by the selection of the object. The AR wearable device then matches the tags of the objects with tags associated with AR applications. The AR wearable device presents on a display of the AR wearable device indications of the AR applications with matching tags, which provides a user with the opportunity to invoke one of the AR applications. The AR wearable device recognizes a selection of an AR application in a number of different ways including gesture recognition and voice commands.

公开(公告)号：US20230394561A1

公开(公告)日：2023-12-07

申请号：US17830661

申请日：2022-06-02

Applicant: Snap Inc.

Inventor： Piotr GURGUL ,  Sharon Moll

IPC: G06Q30/06

CPC classification number: G06Q30/0643 ,  G06Q30/0633 ,  G06K7/1404

Abstract: A method of providing a shopping user interface for a head-mounted display device includes detecting a product barcode in a field of view of head-mounted display device. Product and pricing information for an item is retrieved based on information in the barcode. The product and pricing information may include an item identifier and a price, which are displayed in a first display area of the head-mounted display device. After a brief delay in which a default quantity can be adjusted, the item identifier and the price are transferred into a shopping cart list display area of the head-mounted display device.

公开(公告)号：US20230384928A1

公开(公告)日：2023-11-30

申请号：US17804818

申请日：2022-05-31

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Dawei Zhang

IPC: G06F3/04886 ,  G06F3/04842 ,  G06F3/01

CPC classification number: G06F3/04886 ,  G06F3/04842 ,  G06F3/011

Abstract: A gesture-based text entry user interface for an Augmented Reality (AR) device is provided. The AR system detects a start text entry gesture made by a user of the AR system, generates a virtual keyboard user interface including a virtual keyboard having a plurality of virtual keys, and provides to the user the virtual keyboard user interface. The AR system determines using the one or more cameras, the user's selection of one or more selected virtual keys of the plurality of virtual keys and generates entered text data based on the one or more selected virtual keys. The AR system provides the entered text data to the user using a display of the AR system.

公开(公告)号：US20230297161A1

公开(公告)日：2023-09-21

申请号：US17655125

申请日：2022-03-16

Applicant: Snap Inc.

Inventor： Sharon Moll

IPC: G06F3/01 ,  G06F3/16 ,  G06F3/04815 ,  G06T19/00

CPC classification number: G06F3/011 ,  G06F3/167 ,  G06F3/017 ,  G06F3/04815 ,  G06T19/003 ,  G06T19/006

Abstract: Feedback is provided to the user of an augmented or virtual reality device based on detecting the proximity of a user's hand to an interactive virtual object that is being displayed by the device. More particularly, a method of providing feedback in display device including a camera, comprises displaying a virtual object on the display device, tracking a user's hand in the field of view of the camera, determining proximity of the user's hand to the virtual object, and based on proximity of the user's hand to the virtual object, providing audible or visual user feedback to the user of the device.

公开(公告)号：US20250095304A1

公开(公告)日：2025-03-20

申请号：US18959194

申请日：2024-11-25

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll ,  Tomasz Zakrzewski

IPC: G06T19/00 ,  G06F3/01 ,  G06T7/73 ,  G06V20/52 ,  G06V20/68

Abstract: Systems, methods, and computer readable media for object counting on augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable display of a count of objects as part of a user view. Upon receipt of a request to count objects, the AR wearable device captures an image of the user view. The AR wearable device transmits the image to a backend for processing to determine the objects in the image. The AR wearable device selects a group of objects of the determined objects to count and overlays boundary boxes over counted objects within the user view. The position of the boundary boxes is adjusted to account for movement of the AR wearable device. A hierarchy of objects is used to group together objects that are related but have different labels or names.