公开(公告)号：US20240054283A1

公开(公告)日：2024-02-15

申请号：US18495574

申请日：2023-10-26

Applicant: Snap Inc.

Inventor： Jeremy Voss ,  Christie Marie Heikkinen ,  Daniel Rakhamimov ,  Laurent Desserrey ,  Susan Marie Territo ,  Edward Koai

IPC: G06F40/166 ,  G06F3/0482 ,  H04L51/52 ,  H04L51/216

CPC classification number: G06F40/166 ,  G06F3/0482 ,  H04L51/52 ,  H04L51/216

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for replacing text in a message thread. The program and method provide for receiving an indication of user input provided by a first user, the user input comprising a text-based term for updating a message thread between the first user and a second user; determining that the text-based term is included within a set of predefined terms, each predefined term within the set of predefined terms having corresponding replacement content for including in the message thread, the replacement content having been specified by the first or second user with respect to messages exchanged between the first and second user; and providing, in response to the determining and based on the set of predefined terms, the replacement content corresponding to the text-based term within the message thread.

公开(公告)号：US11900506B2

公开(公告)日：2024-02-13

申请号：US17470231

申请日：2021-09-09

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Shuvi ,  Matan Zohar

IPC: G06T11/00 ,  G06V40/16 ,  G06Q30/0601

CPC classification number: G06T11/00 ,  G06Q30/0643 ,  G06V40/168 ,  G06V40/174

Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the image; identifying a facial expression of the user depicted in the image; and in response to identifying the facial expression, applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.

公开(公告)号：US11900058B2

公开(公告)日：2024-02-13

申请号：US18101194

申请日：2023-01-25

Applicant: Snap Inc.

Inventor： Yu Jiang Tham ,  Jonathan M. Rodriguez, II ,  Nir Daube

IPC: G06F3/04812 ,  G06F40/274 ,  G06F3/01 ,  H04L51/06 ,  G06F3/04886

CPC classification number: G06F40/274 ,  G06F3/014 ,  G06F3/04812 ,  G06F3/04886 ,  H04L51/06

Abstract: Systems, devices, media, and methods are presented for composing and sharing a message based on the motion of a handheld electronic device such as a ring. The methods in some implementations include presenting a keyboard on a display, collecting course data associated with a course traveled by the ring, and overlying a trace onto the keyboard, such that the trace is correlated in near real-time with the course traveled by the ring. In some implementations the display element is part of a portable device, such as the lens of an electronic eyewear device. Based on the course data relative to the key locations on the keyboard, the system identifies and presents candidate words to be included in a message.

公开(公告)号：US20240046072A1

公开(公告)日：2024-02-08

申请号：US18489730

申请日：2023-10-18

Applicant: Snap Inc.

Inventor： Linjie Yang ,  Jianchao Yang ,  Xuehan Xiong ,  Yanran Wang

IPC: G06N3/045 ,  G06N3/08 ,  G06T7/10 ,  G06F17/18 ,  H04L51/52

CPC classification number: G06N3/045 ,  G06N3/08 ,  G06T7/10 ,  G06F17/18 ,  H04L51/52

Abstract: A modulated segmentation system can use a modulator network to emphasize spatial prior data of an object to track the object across multiple images. The modulated segmentation system can use a segmentation network that receives spatial prior data as intermediate data that improves segmentation accuracy. The segmentation network can further receive visual guide information from a visual guide network to increase tracking accuracy via segmentation.

公开(公告)号：US20240045494A1

公开(公告)日：2024-02-08

申请号：US18382737

申请日：2023-10-23

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Shin Hwun Kang ,  Doug Mead

IPC: G06F3/01 ,  H04B1/3827 ,  H04W4/029 ,  G06T7/73 ,  G06F18/22

CPC classification number: G06F3/012 ,  H04B1/385 ,  H04W4/029 ,  G06T7/74 ,  G06F18/22 ,  H04B2001/3866

Abstract: Systems, devices, media, and methods are presented for an immersive augmented reality (AR) experience using an eyewear device. A portable eyewear device includes a processor, a memory, and a display projected onto at least one lens assembly. The memory has programming stored therein that, when executed by the processor, captures information depicting an environment surrounding the device and identifies a match between objects in that information and predetermined objects in previously obtained information for the same environment. When the position of the eyewear device reaches a preselected location with respect to the matched objects, a physical output is provided to produce the immersive experience. The physical output changes as the position of the eyewear device moves to maintain the immersive experience.

公开(公告)号：US11893689B2

公开(公告)日：2024-02-06

申请号：US17819198

申请日：2022-08-11

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Ebony James Charlton ,  Andrew James McPhee ,  Michael John Evans

IPC: G06T17/20 ,  G06T7/55 ,  G06V20/64 ,  G06V40/60 ,  G06V40/16

CPC classification number: G06T17/20 ,  G06T7/55 ,  G06V20/64 ,  G06V40/167 ,  G06V40/67 ,  G06T2200/08 ,  G06T2200/24 ,  G06T2207/30201

Abstract: In various example embodiments, a system and methods are presented for generation and manipulation of three dimensional (3D) models. The system and methods cause presentation of an interface frame encompassing a field of view of an image capture device. The systems and methods detect an object of interest within the interface frame, generate a movement instruction with respect to the object of interest, and detect a first change in position and a second change in position of the object of interest. The systems and methods generate a 3D model of the object of interest based on the first change in position and the second change in position.

公开(公告)号：US11893166B1

公开(公告)日：2024-02-06

申请号：US17983040

申请日：2022-11-08

Applicant: Snap Inc.

Inventor： Lien Le Hong Tran ,  William Miles Miller

IPC: G06F3/0346 ,  G06F3/01

CPC classification number: G06F3/0346 ,  G06F3/011

Abstract: Systems and methods are provided for performing operations on an augmented reality (AR) device. The system accesses, by the AR device, movement data comprising inertial measurement data and camera data. The system determines three-dimensional (3D) movement of the AR device based on the movement data. The system presents, by the AR device, an AR object on a real-world environment being viewed using the AR device. The system, in response to determining the 3D movement of the AR device, modifies the AR object by the AR device.

公开(公告)号：US20240037882A1

公开(公告)日：2024-02-01

申请号：US17946643

申请日：2022-09-16

Applicant: Snap Inc.

Inventor： Cai Zhu ,  Chuangwen Liu ,  Haoyun Wu ,  Weihao Yuan

IPC: G06T19/20 ,  G06T19/00

CPC classification number: G06T19/20 ,  G06T19/006

Abstract: Image augmentation effects are provided on a device that includes a display and a camera. A simplified augmented reality effect is applied to a stream of images captured by the camera, to generate a preview stream of images. The preview stream of images is displayed on the display. A second stream of images corresponding to the first stream of images is saved to an initial video file. A full augmented reality effect, corresponding to the simplified augmented reality affect, is then applied to the second stream of images to generate a fully-augmented stream of images, which are saved to a further video file. The further video file can then be played back on the display to show the final, fully augmented reality effect as applied to the stream of images.

公开(公告)号：US20240037809A1

公开(公告)日：2024-02-01

申请号：US18485996

申请日：2023-10-12

Applicant: Snap Inc.

Inventor： Riccardo Boscolo ,  Jean Luo ,  Vincent Sung ,  Ibram Uppal

IPC: G06T11/00 ,  H04L51/046 ,  G06Q30/0601

CPC classification number: G06T11/00 ,  H04L51/046 ,  G06Q30/0633 ,  G06Q30/0641 ,  G06F3/0482

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality-based makeup. The program and method provide for receiving a request to present augmented reality content in association with an image captured by a device camera, the image depicting a user's face; accessing an augmented reality content item applying makeup to the face, the augmented reality content configured to generate a mesh for tracking plural regions of the face and to present available makeup products with respect to the plural regions; presenting the augmented reality content item in association with the face depicted in the image; receiving user input selecting a region of the plural regions; determining a set of available makeup products corresponding to the selected region; and updating presentation of the augmented reality content item based on the set of available makeup products.

公开(公告)号：US11887357B2

公开(公告)日：2024-01-30

申请号：US17547548

申请日：2021-12-10

Applicant: Snap Inc.

Inventor： Jianchao Yang ,  Ning Xu ,  Jian Ren

IPC: G06K9/62 ,  G06V10/774 ,  G06F18/214 ,  G06F18/24 ,  G06F18/21 ,  G06F18/25 ,  G06V30/19 ,  G06V10/776 ,  G06V10/82 ,  H04L51/212

CPC classification number: G06V10/7753 ,  G06F18/217 ,  G06F18/2155 ,  G06F18/24 ,  G06F18/254 ,  G06V10/776 ,  G06V10/82 ,  G06V30/1916 ,  G06V30/19173 ,  H04L51/212

Abstract: Disclosed herein are arrangements that facilitate the transfer of knowledge from models for a source data-processing domain to models for a target data-processing domain. A convolutional neural network space for a source domain is factored into a first classification space and a first reconstruction space. The first classification space stores class information and the first reconstruction space stores domain-specific information. A convolutional neural network space for a target domain is factored into a second classification space and a second reconstruction space. The second classification space stores class information and the second reconstruction space stores domain-specific information. Distribution of the first classification space and the second classification space is aligned.