公开(公告)号：US20250068326A1

公开(公告)日：2025-02-27

申请号：US18944816

申请日：2024-11-12

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Dawei Zhang

IPC: G06F3/04886 ,  G06F3/01 ,  G06F3/042

Abstract: A gesture-based text entry user interface for an Augmented Reality (AR) system is provided. The AR system detects a start text entry gesture made by a user of the AR system, generates a virtual keyboard user interface including a virtual keyboard having a plurality of virtual keys, and provides to the user the virtual keyboard user interface. The AR system detects a hold of an enter text gesture made by the user. While the user holds the enter text gesture, the AR system collects continuous motion gesture data of a continuous motion as the user makes the continuous motion through the virtual keys of the virtual keyboard. The AR system detects a release of the enter text gesture by the user and generates entered text data based on the continuous motion gesture data.

公开(公告)号：US20240187711A1

公开(公告)日：2024-06-06

申请号：US18440603

申请日：2024-02-13

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul ,  Dawei Zhang

IPC: H04N21/8545 ,  G06F3/04817 ,  G06K19/06

CPC classification number: H04N21/8545 ,  G06F3/04817 ,  G06K19/06037

Abstract: A mixed-reality media content system may be configured to perform operations that include: causing display of image data at a client device, the image data comprising a depiction of an object that includes a graphical code at a position upon the object; detecting the graphical code at the position upon the depiction of the object based on the image data; accessing media content within a media repository based on the graphical code scanned by the client device; and causing display of a presentation of the media content at the position of the graphical code upon the depiction of the object at the client device.

公开(公告)号：US20240144673A1

公开(公告)日：2024-05-02

申请号：US18050360

申请日：2022-10-27

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul

IPC: G06V20/10 ,  G06T7/20 ,  G06T19/00 ,  G06V10/764

CPC classification number: G06V20/188 ,  G06T7/20 ,  G06T19/006 ,  G06V10/764 ,  G06T2207/30188

Abstract: An augmented reality (AR) plant content system is provided. The AR plant content system may detect an object in a real world scene that corresponds to a plant. The AR plant content system may generate care instructions for the plant that include AR graphics that are displayed as overlays of the real world scene. The AR plant content system may also track the motion of objects in the real world scene to determine that plant care events have taken place, such as watering the plant or pruning the plant. A plant inventory may be produced that includes care instructions and a log of plant care events for plants that correspond to one or more users.

公开(公告)号：US20240096031A1

公开(公告)日：2024-03-21

申请号：US17947889

申请日：2022-09-19

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll

IPC: G06T19/00 ,  G02B27/01 ,  G06T7/70 ,  G06T19/20 ,  G06V10/74 ,  G06V20/20

CPC classification number: G06T19/006 ,  G02B27/0172 ,  G06T7/70 ,  G06T19/20 ,  G06V10/761 ,  G06V20/20 ,  G02B2027/0178 ,  G06T2219/2004 ,  G06T2219/2016

Abstract: Systems, methods, and computer readable media for graphical assistance with tasks using an augmented reality (AR) wearable devices are disclosed. Embodiments capture an image of a first user view of a real-world scene and access indications of surfaces and locations of the surfaces detected in the image. The AR wearable device displays indications of the surfaces on a display of the AR wearable device where the locations of the indications are based on the locations of the surfaces and a second user view of the real-world scene. The locations of the surfaces are indicated with 3D world coordinates. The user views are determined based on a location of the user. The AR wearable device enables a user to add graphics to the surfaces and select tasks to perform. Tools such as a bubble level or a measuring tool are available for the user to utilize to perform the task.

公开(公告)号：US20240070996A1

公开(公告)日：2024-02-29

申请号：US17893738

申请日：2022-08-23

Applicant: Snap Inc.

Inventor： Piotr GURGUL ,  Sharon Moll ,  Tomasz Zakrzewski

IPC: G06T19/00 ,  G06F3/01 ,  G06T7/73 ,  G06V20/52 ,  G06V20/68

CPC classification number: G06T19/006 ,  G06F3/011 ,  G06T7/73 ,  G06V20/53 ,  G06V20/68 ,  G06T2200/16 ,  G06T2200/24 ,  G06T2207/30242 ,  G06T2210/12

Abstract: Systems, methods, and computer readable media for object counting on augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable display of a count of objects as part of a user view. Upon receipt of a request to count objects, the AR wearable device captures an image of the user view. The AR wearable device transmits the image to a backend for processing to determine the objects in the image. The AR wearable device selects a group of objects of the determined objects to count and overlays boundary boxes over counted objects within the user view. The position of the boundary boxes is adjusted to account for movement of the AR wearable device. A hierarchy of objects is used to group together objects that are related but have different labels or names.

公开(公告)号：US20240069856A1

公开(公告)日：2024-02-29

申请号：US17823169

申请日：2022-08-30

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul

IPC: G06F3/16 ,  G06F3/04817 ,  G06F3/0484 ,  G10L15/16 ,  G10L15/22

CPC classification number: G06F3/167 ,  G06F3/04817 ,  G06F3/0484 ,  G10L15/16 ,  G10L15/22 ,  G10L2015/223

Abstract: Systems, methods, and computer readable media for voice-controlled user interfaces (UIs) for augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable a user to interact with the AR wearable device without using physical user interface devices. An application has a non-voice-controlled UI mode and a voice-controlled UI mode. The user selects the mode of the UI. The application running on the AR wearable device displays UI elements on a display of the AR wearable device. The UI elements have types. Predetermined actions are associated with each of the UI element types. The predetermined actions are displayed with other information and used by the user to invoke the corresponding UI element.

公开(公告)号：US20230410441A1

公开(公告)日：2023-12-21

申请号：US17845626

申请日：2022-06-21

Applicant: Snap Inc.

Inventor： Sharon Moll

IPC: G06T19/00 ,  G06F3/01 ,  G06F3/04815 ,  G06F3/0482 ,  G06T7/70 ,  G06T3/40 ,  G06T7/20

CPC classification number: G06T19/006 ,  G06F3/011 ,  G06F3/04815 ,  G06T2200/24 ,  G06T7/70 ,  G06T3/40 ,  G06T7/20 ,  G06F3/0482

Abstract: An Augmented Reality (AR) graphics system is provided. The AR graphics system may detect an object in a real-world scene that corresponds to an AR graphics display surface. The AR graphics system may generate AR graphics that are displayed as overlays of the AR graphics display surface. The AR graphics system may track the motion of a graphics input tool with respect to the AR graphics display surface to generate AR graphics based on the motion of the graphics input tool. The AR graphics may be comprised of a number of markings generated based on the motion of the graphics input tool.

公开(公告)号：US20250097548A1

公开(公告)日：2025-03-20

申请号：US18970441

申请日：2024-12-05

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul ,  Dawei Zhang

IPC: H04N21/8545 ,  G06F3/04817 ,  G06K19/06

Abstract: A mixed-reality media content system may be configured to perform operations that include: causing display of image data at a client device, the image data comprising a depiction of an object that includes a graphical code at a position upon the object; detecting the graphical code at the position upon the depiction of the object based on the image data; accessing media content within a media repository based on the graphical code scanned by the client device; and causing display of a presentation of the media content at the position of the graphical code upon the depiction of the object at the client device.

公开(公告)号：US20240420484A1

公开(公告)日：2024-12-19

申请号：US18817024

申请日：2024-08-27

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Tomasz Zakrzewski

IPC: G06V20/58 ,  B60W30/18 ,  B60W40/105 ,  G06F1/16

Abstract: Disclosed is a method of providing a proximity warning using a head-worn device. A distance is determined between the head-worn device and a relevant object, such as a cyclist, jogger or vehicle, using image-processing techniques. A speed of the head-worn device is determined using a GPS receiver or other position components located in the head-worn device or an associated user device. A braking distance for the head-worn device is determined based on the speed of the head-worn device, and compared to the distance to the relevant object. A warning notification is provided by the head-worn device if the distance to the relevant object is less than the braking distance.

公开(公告)号：US20240411629A1

公开(公告)日：2024-12-12

申请号：US18810020

申请日：2024-08-20

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll

IPC: G06F9/54 ,  G06T19/00

Abstract: Systems, methods, and computer readable media are described for remotely changing settings on augmented reality (AR) wearable devices. Embodiments are disclosed that enable a user to change settings of an AR wearable device on a user interface (UI) provided by a host client device that can communicate wirelessly with the AR wearable device. The host client device and AR wearable device provide remote procedure calls (RPCs) and an application program interface (API) to access settings and determine if settings have been changed. The API enables the host client device to determine the settings on the AR wearable device without any prior knowledge of the settings on the AR wearable device. The RPCs and the API enable the host client device to automatically update the settings on the AR wearable device when the user changes the settings on the host client device.