公开(公告)号：US20240135633A1

公开(公告)日：2024-04-25

申请号：US18400289

申请日：2023-12-29

Applicant: Snap Inc.

Inventor： Kai Zhou ,  Qi Qi ,  Jeroen Hol

IPC: G06T15/20 ,  G06T7/20 ,  G06T7/50 ,  G06T7/70

CPC classification number: G06T15/20 ,  G06T7/20 ,  G06T7/50 ,  G06T7/70 ,  G06T2207/30241 ,  G06T2207/30244

Abstract: Systems and methods of generating ground truth datasets for producing virtual reality (VR) experiences, for testing simulated sensor configurations, and for training machine-learning algorithms. In one example, a recording device with one or more cameras and one or more inertial measurement units captures images and motion data along a real path through a physical environment. A SLAM application uses the captured data to calculate the trajectory of the recording device. A polynomial interpolation module uses Chebyshev polynomials to generate a continuous time trajectory (CTT) function. The method includes identifying a virtual environment and assembling a simulated sensor configuration, such as a VR headset. Using the CTT function, the method includes generating a ground truth output dataset that represents the simulated sensor configuration in motion along a virtual path through the virtual environment. The virtual path is closely correlated with the motion along the real path as captured by the recording device. Accordingly, the output dataset produces a realistic and life-like VR experience. In addition, the methods described can be used to generate multiple output datasets, at various sample rates, which are useful for training the machine-learning algorithms which are part of many VR systems.

公开(公告)号：US20240134724A1

公开(公告)日：2024-04-25

申请号：US18049174

申请日：2022-10-23

Applicant: Snap Inc.

Inventor： Adithya Gajulapally ,  Piotr Gurgul ,  Andrew Ly ,  Sharon Moll

IPC: G06F9/54 ,  H04L67/133

CPC classification number: G06F9/547 ,  H04L67/133

Abstract: Systems, methods, and computer readable media for a service manger to manage services on a wearable device are disclosed. The service manager remains active in memory and listens for requests for services. The service manager then determines which services to run and which to stop to respond to the requests for services. After running a service, the service manager calls the service to respond to the request and sends a response to the request to the sender of the request. The service manager may be resident on a different processor than a processor from which the requests for services originate. The service manager maintains priorities of the services to determine which services to stop or remove from memory.

公开(公告)号：US20240130496A1

公开(公告)日：2024-04-25

申请号：US18400191

申请日：2023-12-29

Applicant: Snap Inc.

Inventor： Stephen Andrew Steger ,  Tiffany Ming Tsao ,  Qiaokun Huang

IPC: A45C11/04 ,  H02J7/00 ,  H02J7/34

CPC classification number: A45C11/04 ,  H02J7/0044 ,  H02J7/0047 ,  H02J7/342 ,  H02J7/0048

Abstract: A carry case for an electronics-enabled eyewear device has incorporated therein electronic components for connection to the eyewear device while storing the eyewear device. The case comprises a rigid frame structure defining an openable holding space for the pair of smart glasses, and a compressible shock-resistant protective cover on the frame structure. The exterior of the case may be predominantly defined by the shock resistant protective cover.

公开(公告)号：US20240127550A1

公开(公告)日：2024-04-18

申请号：US18046367

申请日：2022-10-13

Applicant: Snap Inc.

Inventor： Ilteris Kaan Canberk ,  Matthew Hallberg ,  Bernhard Jung

IPC: G06T19/00 ,  G06T7/70

CPC classification number: G06T19/006 ,  G06T7/70 ,  G06T2200/24 ,  G06T2207/10028 ,  G06T2210/56 ,  G06T2219/004

Abstract: Systems, methods, and computer readable media for remote annotations, drawings, and navigation instructions sent to an augmented reality (AR) wearable device from a computing device are disclosed. The AR wearable device captures images and sends them to the remote computing device to provide a real-time view of what the user of the AR wearable device sees. A user of the remote computing device can add navigation instructions and can select an image to annotate or draw on. The AR wearable device provides 3-dimensional (3D) coordinate information within a 3D world of the AR wearable device for the selected image. The user of the remote computing device then annotates or draws on the selected image. The remote computing device determines 3D coordinates for the annotations and drawings within the 3D world of the AR wearable device. The annotations and drawings are sent to the AR wearable device with associated 3D coordinates.

公开(公告)号：US20240127006A1

公开(公告)日：2024-04-18

申请号：US17967209

申请日：2022-10-17

Applicant: Snap Inc.

Inventor： Kai Zhou ,  Jennica Pounds ,  Zsolt Robotka ,  Márton Gergely Kajtár

IPC: G06F40/58 ,  G06F3/01 ,  G06F3/0346 ,  G06V10/26 ,  G06V20/20 ,  G06V40/10 ,  G06V40/20

CPC classification number: G06F40/58 ,  G06F3/014 ,  G06F3/017 ,  G06F3/0346 ,  G06V10/26 ,  G06V20/20 ,  G06V40/113 ,  G06V40/28

Abstract: A method for recognizing sign language using collaborative augmented reality devices is described. In one aspect, a method includes accessing a first image generated by a first augmented reality device and a second image generated by a second augmented reality device, the first image and the second image depicting a hand gesture of a user of the first augmented reality device, synchronizing the first augmented reality device with the second augmented reality device, in response to the synchronizing, distributing one or more processes of a sign language recognition system between the first and second augmented reality devices, collecting results from the one or more processes from the first and second augmented reality devices, and displaying, in near real-time in a first display of the first augmented reality device, text indicating a sign language translation of the hand gesture based on the results.

公开(公告)号：US20240126824A1

公开(公告)日：2024-04-18

申请号：US18535988

申请日：2023-12-11

Applicant: Snap Inc.

Inventor： Efrat Rotem ,  Ariel Krieger ,  Emmanuel Merali

IPC: G06F16/9536 ,  G06F16/28 ,  G06F16/951 ,  G06F16/9535 ,  G06F16/9538 ,  G06F16/958 ,  G06F40/20 ,  G06Q50/00 ,  H04L67/02

CPC classification number: G06F16/9536 ,  G06F16/285 ,  G06F16/951 ,  G06F16/9535 ,  G06F16/9538 ,  G06F16/958 ,  G06F40/20 ,  G06Q50/01 ,  H04L67/02

Abstract: A method for enhancing a presentation of a network document by a client terminal with real time social media content. The method comprises analyzing a content in a web document to identify a relation to a first of a plurality of multi participant events documented in an event dataset, each of the plurality of multi participant events is held in a geographical venue which hosts an audience of a plurality of participants, matching a plurality of event indicating tags of each of a plurality of user uploaded media content files with at least one feature of the first multi participant event to identify a group of user uploaded media content files selected from the plurality of user uploaded media content files, and forwarding at least some members of the group to a simultaneous presentation on a browser running on a client terminal and presenting the web document.

公开(公告)号：US20240126502A1

公开(公告)日：2024-04-18

申请号：US18397786

申请日：2023-12-27

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul

IPC: G06F3/16 ,  G06F3/04817 ,  G06F3/0484 ,  G10L15/16 ,  G10L15/22

CPC classification number: G06F3/167 ,  G06F3/04817 ,  G06F3/0484 ,  G10L15/16 ,  G10L15/22 ,  G10L2015/223

Abstract: Systems, methods, and computer readable media for voice-controlled user interfaces (UIs) for augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable a user to interact with the AR wearable device without using physical user interface devices. An application has a non-voice-controlled UI mode and a voice-controlled UI mode. The user selects the mode of the UI. The application running on the AR wearable device displays UI elements on a display of the AR wearable device. The UI elements have types. Predetermined actions are associated with each of the UI element types. The predetermined actions are displayed with other information and used by the user to invoke the corresponding UI element.

公开(公告)号：US20240126099A1

公开(公告)日：2024-04-18

申请号：US18399378

申请日：2023-12-28

Applicant: Snap Inc.

Inventor： Michael Ryner ,  Stephen Steger

IPC: G02C5/22

CPC classification number: G02C5/2227 ,  G02C11/10

Abstract: Eyewear having a frame, a hinge, and a hyperextendable temple. An extender is coupled to the hinge and the temple, and the extender extends with respect to the hinge allowing hyperextension of the temple with respect to the frame. The extender may include a bushing and a spring that allows the temple hyperextension, and which also creates a bias force to urge the temple against a user's head during use.

公开(公告)号：US11962547B2

公开(公告)日：2024-04-16

申请号：US16586473

申请日：2019-09-27

Applicant: Snap Inc.

Inventor： Newar Husam Al Majid ,  Nathan Kenneth Boyd ,  Laurent Desserrey ,  Matthew Thompson ,  Jeremy Voss

IPC: G06F16/903 ,  G06F3/04842 ,  G06F3/0485 ,  G06F9/451 ,  G06F16/9038 ,  H04L51/043 ,  H04L51/046 ,  H04L51/10

CPC classification number: H04L51/043 ,  G06F3/04842 ,  G06F3/0485 ,  G06F9/451 ,  G06F16/90348 ,  G06F16/9038 ,  H04L51/046 ,  H04L51/10

Abstract: Systems and methods are provided for performing operations including: retrieving a plurality of content items; determining a first category of a first content item in the plurality of content items; selecting a first presentation arrangement from a plurality of presentation arrangements based on the first category determined for the first content item; and presenting the first content item to a user according to the selected first presentation arrangement.

公开(公告)号：US11961196B2

公开(公告)日：2024-04-16

申请号：US18123028

申请日：2023-03-17

Applicant: Snap Inc.

Inventor： Ebony James Charlton ,  Jokubas Dargis ,  Eitan Pilipski ,  Dhritiman Sagar ,  Victor Shaburov

IPC: G06T19/00 ,  A63F13/213 ,  A63F13/428 ,  G06T15/00 ,  H04W4/02 ,  H04W4/021 ,  G06F16/95

CPC classification number: G06T19/006 ,  A63F13/213 ,  A63F13/428 ,  G06T19/003 ,  H04W4/02 ,  H04W4/021 ,  G06F16/95 ,  G06T15/00

Abstract: A context based augmented reality system can be used to display augmented reality elements over a live video feed on a client device. The augmented reality elements can be selected based on a number of context inputs generated by the client device. The context inputs can include location data of the client device and location data of nearby physical places that have preconfigured augmented elements. The preconfigured augmented elements can be preconfigured to exhibit a design scheme of the corresponding physical place.