公开(公告)号：US20240303945A1

公开(公告)日：2024-09-12

申请号：US18665388

申请日：2024-05-15

Applicant: Snap Inc.

Inventor： Rastan Boroujerdi ,  Michael John Evans ,  Panayoti Haritatos

IPC: G06T19/00 ,  G01C21/36 ,  G06F3/04815 ,  G06F3/04842 ,  H04L9/40

CPC classification number: G06T19/006 ,  G01C21/3647 ,  G06F3/04815 ,  G06F3/04842 ,  H04L63/083 ,  G06T2200/24 ,  G06T2219/024

Abstract: Methods and systems are disclosed for generating AR experiences. The methods and systems access a first component of a plurality of components implemented by the messaging application, the plurality of components comprising an AR experience, each of the plurality of components being configured to be separately launched by the messaging application. The methods and systems store a first state of the first component in a data structure that is shared across the plurality of components; launching. The methods and system launch, by the messaging application, a second component of the plurality of components in response to determining that an interaction has been performed using the first component; and configure a second state of the second component based on the interaction that has been performed using the first component.

公开(公告)号：US20240303926A1

公开(公告)日：2024-09-12

申请号：US18179717

申请日：2023-03-07

Applicant: Snap Inc.

Inventor： Riza Alp Guler ,  Dominik Kulon ,  Himmy Tam ,  Haoyang Wang

IPC: G06T17/20 ,  G06T7/40 ,  G06T11/00

CPC classification number: G06T17/20 ,  G06T7/40 ,  G06T11/00 ,  G06T2200/24 ,  G06T2207/10028 ,  G06T2207/20081 ,  G06T2207/30196 ,  G06T2210/22 ,  G06T2210/56

Abstract: An system for augmenting images using hand surface normal estimation is provided. In a model training phase, 3D models of hands are generated using 3D data of hands in a variety of positions. Target normal training data is generated that includes normals of surfaces of the 3D models and synthetic 2D image training data corresponding to the 3D models and the normals. The target normal training data and the synthetic image training data are used to train a normal estimation model. The normal estimation is used by an interactive application to generate augmentations that are applied to hand image data.

公开(公告)号：US12088544B2

公开(公告)日：2024-09-10

申请号：US17991539

申请日：2022-11-21

Applicant: Snap Inc.

Inventor： Nathan Kenneth Boyd ,  Jacob Catalano ,  Jeremy Baker Voss

IPC: H04L51/10 ,  H04L51/063 ,  H04L51/216

CPC classification number: H04L51/10 ,  H04L51/063 ,  H04L51/216

Abstract: Systems and methods herein save ephemeral media content to a conversation thread between two users who are bidirectional connections on a social media platform. The systems and methods receive, on a first device associated with a first user, media content item from a second device associated with a second user, display the received media content item on the first user device, and while causing display of the received media content item, receive a selection from the first user device. In response to receiving the selection, the systems and methods save the media content item to a conversation thread between the first user and the second user and display an indication that the media content item is saved within the conversation thread.

公开(公告)号：US12086946B2

公开(公告)日：2024-09-10

申请号：US18475813

申请日：2023-09-27

Applicant: Snap Inc.

Inventor： Matan Zohar ,  Yanli Zhao ,  Brian Fulkerson

IPC: G06T17/20 ,  G06T7/246 ,  G06T13/40 ,  G06T13/80 ,  G06T19/00 ,  G06T19/20

CPC classification number: G06T19/006 ,  G06T7/251 ,  G06T13/40 ,  G06T13/80 ,  G06T17/20 ,  G06T19/20 ,  G06T2200/24 ,  G06T2207/10016 ,  G06T2219/2021

Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; obtaining an external mesh associated with an augmented reality (AR) element; automatically establishing a correspondence between a portion of the 3D body mesh associated with the real-world object and the external mesh; blending the portion of the 3D body mesh into the external mesh according to a blending parameter; and as the portion of the 3D body mesh is being blended into the external mesh, modifying the video to depict a portion of the real-world object being changed into the AR element.

公开(公告)号：US12082768B2

公开(公告)日：2024-09-10

申请号：US17513355

申请日：2021-10-28

Applicant: Snap Inc.

Inventor： Dylan Shane Eirinberg ,  Daniel Trinh

IPC: A47L9/28 ,  A47L7/00 ,  G05D1/00 ,  G06V20/10 ,  H04L51/10 ,  H04L51/222 ,  H04L67/306

CPC classification number: A47L9/2894 ,  A47L7/0004 ,  A47L9/2826 ,  A47L9/2847 ,  A47L9/2852 ,  G05D1/0016 ,  G05D1/0221 ,  G05D1/0287 ,  G06V20/176 ,  H04L51/10 ,  H04L51/222 ,  H04L67/306 ,  A47L2201/04 ,  A47L2201/06

Abstract: Methods and systems are disclosed for controlling connected devices. For example, a messaging application implemented on a client device detects a real-world object depicted in a received image and determines a current location of the client device. The messaging application identifies a plurality of robotic cleaning devices associated with an account of the messaging application. The messaging application transmits a message comprising the current location of the client device to a first robotic cleaning device of the plurality of robotic cleaning devices and causes the first robotic cleaning device to clean the real-world object depicted in the received image based on the message transmitted by the messaging application.

公开(公告)号：US20240296645A1

公开(公告)日：2024-09-05

申请号：US18664596

申请日：2024-05-15

Applicant: Snap Inc.

Inventor： Vladislav Shakhrai ,  Sergey Demyanov ,  Mikhail Vasilkovskii ,  Aleksei Stoliar

IPC: G06T19/20 ,  G06T7/40 ,  G06T11/00 ,  G06T17/20

CPC classification number: G06T19/20 ,  G06T7/40 ,  G06T11/001 ,  G06T17/20 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2210/12 ,  G06T2210/22 ,  G06T2219/2016

Abstract: Methods and systems are disclosed for performing operations for generating a photorealistic rendering of an object. The operations include: accessing a set of albedo textures and a machine learning model associated with a real-world object, the set of albedo textures and a machine learning model having been trained based on a plurality of viewpoints of the real-world object; obtaining a three-dimensional (3D) mesh of the real-world object; receiving input that selects a new viewpoint that differs from the plurality of viewpoints of the real-world object; and generating a photorealistic rendering of the real-world object from the new viewpoint based on the 3D mesh of the real-world object, the set of albedo textures, and the machine learning model associated with the real-world object.

公开(公告)号：US20240296640A1

公开(公告)日：2024-09-05

申请号：US18664996

申请日：2024-05-15

Applicant: Snap Inc.

Inventor： Gal Dudovitch ,  Peleg Harel ,  Ma'ayan Mishin Shuvi ,  Itamar Berger ,  Avihay Assouline

IPC: G06T19/00 ,  G06N3/02 ,  G06T19/20

CPC classification number: G06T19/006 ,  G06N3/02 ,  G06T19/20

Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system performs operations including selecting, by a messaging application, a virtual experience that represents a previously captured real-world environment at a first location; accessing an image representing a new real-world environment at a second location, the image depicting a plurality of real-world objects; receiving input that selects a first real-world object from the plurality of real-world objects depicted in the image; and modifying the image, accessed at the second location, based on the virtual experience to depict the previously captured real-world environment with the first real-world object.

公开(公告)号：US12080261B2

公开(公告)日：2024-09-03

申请号：US18142181

申请日：2023-05-02

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Donald Giovannini ,  Sana Park

IPC: G10H1/00 ,  G06T7/90

CPC classification number: G10H1/0025 ,  G06T7/90 ,  G10H1/0041 ,  G06T2207/10024 ,  G06T2207/30204 ,  G10H2220/101 ,  G10H2220/445 ,  G10H2220/455

Abstract: Systems, devices, media, and methods are presented for playing audio sounds, such as music, on a portable electronic device using a digital color image of a note matrix on a map. A computer vision engine, in an example implementation, includes a mapping module, a color detection module, and a music playback module. The camera captures a color image of the map, including a marker and a note matrix. Based on the color image, the computer vision engine detects a token color value associated with each field. Each token color value is associated with a sound sample from a specific musical instrument. A global state map is stored in memory, including the token color value and location of each field in the note matrix. The music playback module, for each column, in order, plays the notes associated with one or more the rows, using the corresponding sound sample, according to the global state map.

公开(公告)号：US12080157B2

公开(公告)日：2024-09-03

申请号：US18367301

申请日：2023-09-12

Applicant: Snap Inc.

Inventor： Ari Krupnik

IPC: H04W88/02 ,  A63H27/00 ,  A63H30/04 ,  G06F3/0482 ,  G06F3/04883 ,  G08C17/02 ,  G10L15/22 ,  H04M1/72415 ,  H04N7/18

CPC classification number: G08C17/02 ,  A63H27/02 ,  A63H30/04 ,  G06F3/0482 ,  G06F3/04883 ,  G10L15/22 ,  H04M1/72415 ,  H04W88/02 ,  G08C2201/93 ,  G10L2015/223 ,  H04N7/183

Abstract: Methods and systems for utilizing a mobile computing device (e.g., such as a mobile phone) for use in controlling a model vehicle are described. Consistent with some embodiments, a mobile computing device provides various user controls for generating signals that are communicated to a radio transmitter device coupled with the mobile computing device, and ultimately broadcast to a receiver residing at a model vehicle. With some embodiments, the mobile computing device may be integrated with a controller housing which provides separate user controls, such that a combination of user controls present on the mobile computing device and the controller housing can be used to control a model vehicle.

公开(公告)号：US12079931B2

公开(公告)日：2024-09-03

申请号：US17856720

申请日：2022-07-01

Applicant: Snap Inc.

Inventor： Nathan Jurgenson ,  Linjie Luo ,  Jonathan M Rodriguez, II ,  Rahul Bhupendra Sheth ,  Jia Li ,  Xutao Lv

IPC: G06T17/00 ,  G06T19/00

CPC classification number: G06T17/00 ,  G06T19/006 ,  G06T2210/56

Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. Point cloud data describing an environment is then accessed. A two-dimensional surface of an image of an environment is captured, and a portion of the image is matched to a portion of key points in the point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.