公开(公告)号：US20240312044A1

公开(公告)日：2024-09-19

申请号：US18184108

申请日：2023-03-15

Applicant: Snap Inc.

Inventor： Tomasz Zakrzewski

IPC: G06T7/70 ,  G06T7/50 ,  G06T19/00

CPC classification number: G06T7/70 ,  G06T7/50 ,  G06T19/006 ,  G06T2200/24 ,  G06T2207/10016 ,  G06T2210/21 ,  G06T2219/004

Abstract: An extended Reality (XR) system that provides services for determining 3D data of physical objects in a real-world scene. The XR system receives a request from an application to initiate a spatial scan of a real-world scene. In response, the XR system captures video frame data of the real-world scene and captures a pose of the XR system. The XR system determines a physical object in the real-world scene and determines a 2D position of the physical object, using the video frame data. The XR system determines a depth of the physical object using the 2D position and determines a 3D position of the physical object in the real-world scene using the 2D position of the physical object, the depth of the physical object, and the pose of the XR system. The XR system communicates the 3D position data to the application.

公开(公告)号：US20240264452A1

公开(公告)日：2024-08-08

申请号：US18639566

申请日：2024-04-18

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul ,  Tomasz Zakrzewski

IPC: G02B27/01 ,  G06F3/01 ,  G06F3/16 ,  G06T19/00

CPC classification number: G02B27/0176 ,  G06F3/016 ,  G06F3/167 ,  G06T19/006 ,  G02B2027/0138

Abstract: Systems, methods, and computer readable media for voice input for augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable a user to interact with the AR wearable device without using physical user interface devices. A keyword is used to indicate that the user is about to speak an action or command. The AR wearable device divides the processing of the audio data into a keyword module that is trained to recognize the keyword and a module to process the audio data after the keyword. In some embodiments, the AR wearable device transmits the audio data after the keyword to a host device to process. The AR wearable device maintains an application registry that associates actions with applications. Applications can be downloaded, and the application registry updated where the applications indicate actions to associate with the application.

公开(公告)号：US20240045217A1

公开(公告)日：2024-02-08

申请号：US17816914

申请日：2022-08-02

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul ,  Tomasz Zakrzewski

IPC: G02B27/01 ,  G06F3/01 ,  G06T19/00

CPC classification number: G02B27/0176 ,  G06F3/016 ,  G06T19/006 ,  G02B2027/0138

Abstract: Systems, methods, and computer readable media for voice input for augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable a user to interact with the AR wearable device without using physical user interface devices. A keyword is used to indicate that the user is about to speak an action or command. The AR wearable device divides the processing of the audio data into a keyword module that is trained to recognize the keyword and a module to process the audio data after the keyword. In some embodiments, the AR wearable device transmits the audio data after the keyword to a host device to process. The AR wearable device maintains an application registry that associates actions with applications. Applications can be downloaded, and the application registry updated where the applications indicate actions to associate with the application.

公开(公告)号：US20230215107A1

公开(公告)日：2023-07-06

申请号：US17651147

申请日：2022-02-15

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Tomasz Zakrzewski

IPC: G06T19/00 ,  G06F3/01 ,  H04W4/80

CPC classification number: G06T19/006 ,  G06F3/017 ,  H04W4/80

Abstract: Systems, methods, and computer readable media for enhanced augmented reality (AR) reading are provided, where the methods include entering a reading mode, capturing an image of a section of reading materials such as a page of a book, identifying a code within the image, and identifying a code module corresponding to the code. The methods further include executing the code module, the code module providing an augmented reality object or virtual reality object related to an object depicted on the section or page, entering a sleep mode for a sleep duration based on an estimated reading time duration of a section or page, awaking after the sleep duration, and capturing a next image. The sleep duration is adjusted based on times when identifiers of the sections of the reading materials such as numbers are captured. The user may manually wake the AR reading device using an external user interface.