公开(公告)号：US20240353835A1

公开(公告)日：2024-10-24

申请号：US18136166

申请日：2023-04-18

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll

IPC: G05D1/00 ,  B64U10/14 ,  G05D1/10 ,  G06T7/11 ,  G06T7/60 ,  G06T7/70 ,  G06V20/17 ,  G06V40/10 ,  H04N23/611 ,  H04N23/73

CPC classification number: G05D1/0094 ,  B64U10/14 ,  G06T7/11 ,  G06T7/60 ,  G06T7/70 ,  G06V20/17 ,  G06V40/11 ,  H04N23/611 ,  H04N23/73 ,  B64U2101/30 ,  B64U2201/10 ,  G06T2207/10032

Abstract: Apparatuses, computer readable medium, and methods for image capturing while circumnavigating objects using mobile devices are disclosed. Example methods include capturing an image, processing the image to identify an object within the image, determining a path around the object and a number of images to capture of the object, dividing the path by the number of images to determine a number of waypoints, and navigating the mobile device to the waypoints and capturing an image of the object at each waypoint of the waypoints. Examples include a person pointing at an object and the mobile device identifying the object based on the person pointing at the object. The mobile device determines a bounding box and a geometric center of the bounding box to determine the path to circumnavigate the object. The mobile device determines a height above a ground to assist in navigation.

公开(公告)号：US12086661B2

公开(公告)日：2024-09-10

申请号：US17929985

申请日：2022-09-06

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll

IPC: G06F9/54 ,  G06T19/00

CPC classification number: G06F9/547 ,  G06T19/006

Abstract: Systems, methods, and computer readable media are described for remotely changing settings on augmented reality (AR) wearable devices. Embodiments are disclosed that enable a user to change settings of an AR wearable device on a user interface (UI) provided by a host client device that can communicate wirelessly with the AR wearable device. The host client device and AR wearable device provide remote procedure calls (RPCs) and an application program interface (API) to access settings and determine if settings have been changed. The API enables the host client device to determine the settings on the AR wearable device without any prior knowledge of the settings on the AR wearable device. The RPCs and the API enable the host client device to automatically update the settings on the AR wearable device when the user changes the settings on the host client device.

公开(公告)号：US20240193982A1

公开(公告)日：2024-06-13

申请号：US18063489

申请日：2022-12-08

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll ,  Pawel Wawruch

IPC: G06V40/10 ,  G02B27/01 ,  G06T7/246 ,  G06T7/73 ,  G06V20/20 ,  G06V20/40 ,  H04N23/20

CPC classification number: G06V40/11 ,  G02B27/0101 ,  G02B27/017 ,  G06T7/251 ,  G06T7/75 ,  G06V20/20 ,  G06V20/46 ,  H04N23/20 ,  G02B2027/0138 ,  G02B2027/014 ,  G06T2207/10048 ,  G06T2207/30196

Abstract: An extended Reality (XR) system provides methodologies for capturing hand poses being made by a user in low-light environments. The XR system capture, using one or more visible light cameras, tracking video frame data of a hand pose of a user of the XR system. The XR system generates hand-tracking data based on the tracking video frame data. The hand-tracking data includes a skeletal model and a hand-tracking confidence level indicating a probability that the skeletal model matches the hand pose. The XR system compares the hand-tracking confidence level to a threshold confidence value, and based on determining the first hand-tracking confidence level is below the threshold confidence value, activates one or more wide-spectrum cameras to capture subsequent tracking video frame data of the hand pose. The XR system may also activate an IR light emitter to illuminate the hands of the user.

公开(公告)号：US11988841B2

公开(公告)日：2024-05-21

申请号：US17816914

申请日：2022-08-02

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul ,  Tomasz Zakrzewski

IPC: G02B27/01 ,  G06F3/01 ,  G06F3/16 ,  G06T19/00

CPC classification number: G02B27/0176 ,  G06F3/016 ,  G06F3/167 ,  G06T19/006 ,  G02B2027/0138

Abstract: Systems, methods, and computer readable media for voice input for augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable a user to interact with the AR wearable device without using physical user interface devices. A keyword is used to indicate that the user is about to speak an action or command. The AR wearable device divides the processing of the audio data into a keyword module that is trained to recognize the keyword and a module to process the audio data after the keyword. In some embodiments, the AR wearable device transmits the audio data after the keyword to a host device to process. The AR wearable device maintains an application registry that associates actions with applications. Applications can be downloaded, and the application registry updated where the applications indicate actions to associate with the application.

公开(公告)号：US20240139611A1

公开(公告)日：2024-05-02

申请号：US18050381

申请日：2022-10-27

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Pawel Wawruch ,  Piotr Gurgul

IPC: A63F1/04 ,  A63F1/02 ,  G06F3/01

CPC classification number: A63F1/04 ,  A63F1/02 ,  G06F3/011 ,  G06F3/017 ,  A63F2001/008

Abstract: Systems, methods, and computer readable media for augmented reality (AR) physical card games. Examples capture an image of a user view of a real-world scene and process the image to determine the locations and codes of physical cards within the image. Overlays are determined for the cards based on the codes. An AR graphics component displays on a display of an AR wearable device the overlays adjusted in accordance with the user view. The overlays may be images, animations, or videos. A card game is downloaded onto the AR wearable device. The card game includes rules that keep track of a score, assist with play, and insure fair play. The card game includes user interfaces that may be shared among the players. Methods include manufacturing the playing cards with computer-readable codes to identify the cards.

公开(公告)号：US11949969B1

公开(公告)日：2024-04-02

申请号：US17956603

申请日：2022-09-29

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul ,  Dawei Zhang

IPC: H04N21/8545 ,  G06F3/04817 ,  G06K19/06

CPC classification number: H04N21/8545 ,  G06F3/04817 ,  G06K19/06037

Abstract: A mixed-reality media content system may be configured to perform operations that include: causing display of image data at a client device, the image data comprising a depiction of an object that includes a graphical code at a position upon the object; detecting the graphical code at the position upon the depiction of the object based on the image data; accessing media content within a media repository based on the graphical code scanned by the client device; and causing display of a presentation of the media content at the position of the graphical code upon the depiction of the object at the client device.

公开(公告)号：US20230315208A1

公开(公告)日：2023-10-05

申请号：US17657911

申请日：2022-04-04

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul ,  Francis Patrick Sullivan ,  Andrei Rybin

IPC: G06F3/01 ,  G06F3/0482

CPC classification number: G06F3/017 ,  G06F3/0482

Abstract: A head-worn device system includes one or more cameras, one or more display devices and one or more processors. The system also includes a memory storing instructions that, when executed by the one or more processors, configure the system to detect a gesture made by a user of the computing apparatus and generate gesture data identifying the gesture, select an application or selected action from a set of registered applications and actions based on the gesture data, and invoke the application or selected action.