-
公开(公告)号:US20240372822A1
公开(公告)日:2024-11-07
申请号:US18141851
申请日:2023-05-01
Applicant: Snap Inc.
Inventor: Lien Le Hong Tran
IPC: H04L51/046 , G06F3/01 , G06T13/20 , G06T13/40 , G06T19/00 , G10L15/26 , H04L51/043
Abstract: Described herein is a messaging application that executes on a wearable augmented reality device. The messaging application facilitates the anchoring or pinning of a 3-D avatar representing another end-user. An end-user wearing the AR device facilitates messaging with the other end-user via interactions with the 3-D avatar representing the other end-user. As such, the AR device processes various sensor inputs to detect when the end-user wearing the AR device is “targeting” the 3-D avatar, and enables an audio recording device to record an audible message for communicating to the other end-user.
-
公开(公告)号:US20240371085A1
公开(公告)日:2024-11-07
申请号:US18770353
申请日:2024-07-11
Applicant: Snap Inc.
Inventor: Gleb Dmukhin , Egor Nemchinov , Yurii Volkov
Abstract: A messaging system performs image processing to estimate lighting properties with neural networks for images provided by users of the messaging system. A method of estimating light properties includes receiving an input image with first lighting properties and processing the input image using a convolutional neural network to generate an estimate of the first lighting properties. The method may further include modifying the input image with an augmentation to generate a modified input image, where the augmentation has second lighting properties, and changing the second lighting properties of the augmentation in the modified input image to the estimate of the first lighting properties.
-
公开(公告)号:US12136160B2
公开(公告)日:2024-11-05
申请号:US17661001
申请日:2022-04-27
Applicant: Snap Inc.
Inventor: Tejas Bahulkar , Edward Lee Kim-Koon , Ashwani Arya
IPC: G06T15/00 , G06F18/214 , G06T19/00 , H04W52/02
Abstract: Methods and systems are disclosed for performing operations for estimating power usage of an AR experience. The operations include: accessing resource utilization data associated with execution of an augmented reality (AR) experience; applying a machine learning technique to the resource utilization data to estimate power consumption of the AR experience, the machine learning technique being trained to establish a relationship between a plurality of training resource utilization data associated with training AR experiences and corresponding ground-truth power consumption of the training AR experiences; and adjusting one or more operations of the AR experience to reduce power consumption based on the estimated power consumption of the AR experience.
-
公开(公告)号:US12136158B2
公开(公告)日:2024-11-05
申请号:US18060449
申请日:2022-11-30
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Yuncheng Li
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the monocular image; and determining a pose represented by the body depicted in the monocular image based on the detected plurality of skeletal joints of the body. A pose of an avatar is modified to match the pose represented by the body depicted in the monocular image by adjusting a set of skeletal joints of a rig of an avatar based on the detected plurality of skeletal joints of the body; and the avatar having the modified pose that matches the pose represented by the body depicted in the monocular image is generated for display.
-
公开(公告)号:US12136026B2
公开(公告)日:2024-11-05
申请号:US18222649
申请日:2023-07-17
Applicant: Snap Inc.
Inventor: Yingzhen Yang , Jianchao Yang , Ning Xu
Abstract: A compact neural network system can generate multiple individual filters from a compound filter. Each convolutional layer of a convolutional neural network can include a compound filters used to generate individual filters for that layer. The individual filters overlap in the compound filter and can be extracted using a sampling operation. The extracted individual filters can share weights with nearby filters thereby reducing the overall size of the convolutional neural network.
-
公开(公告)号:US20240362874A1
公开(公告)日:2024-10-31
申请号:US18767039
申请日:2024-07-09
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi
IPC: G06T19/00 , G06N3/082 , G06Q30/0601
CPC classification number: G06T19/006 , G06N3/082 , G06Q30/0643 , G06T2200/08 , G06T2200/24 , G06T2210/16 , G06T2219/024
Abstract: Aspects of the present disclosure involve a system for providing AR experiences. The system accesses, by a messaging application, an image depicting a real-world fashion item of a user and generates a three-dimensional (3D) virtual fashion item based on the real-world fashion item depicted in the image. The system stores the 3D virtual fashion item in a database that includes a virtual wardrobe comprising a plurality of 3D virtual fashion items associated with the user. The system generates, by the messaging application, an augmented reality (AR) experience that allows the user to interact with the virtual wardrobe.
-
公开(公告)号:US20240362863A1
公开(公告)日:2024-10-31
申请号:US18764665
申请日:2024-07-05
Applicant: Snap Inc.
Inventor: Piers George Cowburn , David Li , Isac Andreas Muller Sandvik , Qi Pan
IPC: G06T17/05 , H04L51/046 , H04L67/306 , H04W4/02
CPC classification number: G06T17/05 , H04L51/046 , H04L67/306 , H04W4/023
Abstract: A location-based augmented-reality system to generate and cause display of augmented-reality content that includes three-dimensional typography, based on a perspective, and location of a client device.
-
公开(公告)号:US20240361615A1
公开(公告)日:2024-10-31
申请号:US18664930
申请日:2024-05-15
Applicant: Snap Inc.
Inventor: Ugur Olgun , Patrick Kusbel , Russell Douglas Patton , Jonathan M. Ridriguez, II , Patrick Timothy McSweeney Simons
IPC: G02C11/00 , G06Q20/32 , H01Q1/27 , H01Q5/50 , H01Q7/00 , H02J50/10 , H04B1/18 , H04B1/3827 , H04B5/24 , H04B5/72
CPC classification number: G02C11/10 , H01Q1/273 , H01Q7/00 , H02J50/10 , H04B1/18 , H04B1/385 , H04B5/24 , H04B5/72 , G06Q20/3278 , H01Q5/50
Abstract: Apparatuses and systems for wearable devices such as eyewear are described. According to one embodiment, the wearable device includes a frame, onboard electronics components, and an antenna disposed around an eyepiece area of the frame that is configured to hold an optical element. The antenna is configured for inductive coupling. In some embodiments, a switch coupled to the antenna allows selection between circuitry for inductive charging of a battery and near-field communication (NFC) circuitry for communicating data via the antenna.
-
公开(公告)号:US12131448B2
公开(公告)日:2024-10-29
申请号:US17937734
申请日:2022-10-03
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi , Gal Sasson , Matan Zohar
CPC classification number: G06T5/77 , G06T5/50 , G06T7/11 , G06T7/20 , G06T11/00 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084 , G06T2207/20221 , G06T2207/30196 , G06T2207/30244
Abstract: Aspects of the present disclosure involve a system for performing real-time in-painting using machine learning techniques. The system receives a video that includes a depiction of a real-world object in a real-world environment. The system accesses a segmentation associated with the real-world object and removes a depiction of the real-world object from a region of a first frame of the video. The system processes, by a machine learning model, the first frame and one or more previous frames of the video that precede the first frame to generate a new frame in which portions of the first frame have been blended into the region from which the depiction of the real-world object has been removed.
-
公开(公告)号:US12131003B2
公开(公告)日:2024-10-29
申请号:US18196915
申请日:2023-05-12
Applicant: Snap Inc.
Inventor: Daniel Amitay , Jonathan Brody , Maxwell Gale , Timothy Jordan Garcia , Daniel Vincent Grippi , Jeffrey Arthur Johnson , Sheridan Kates , Andrew Lin , Walton Lin , Gaurav Misra , Suraj Vindana Samaranayake , Amer Shahnawaz , Evan Spiegel
IPC: G06F3/04817 , G06F3/0482 , G06F3/04842 , G06F3/0488 , G06F16/248 , G06F16/29 , G06F16/487 , G06F16/9535 , G06F16/9537 , G06Q50/00 , G06T11/20 , G06T11/60 , H04L9/40 , H04L41/22 , H04L41/28 , H04L51/52 , H04L67/12 , H04L67/306 , H04L67/50 , H04L67/52 , H04W4/02 , H04W4/029 , H04W4/18 , H04W4/21 , H04W12/02 , G06F9/54
CPC classification number: G06F3/04817 , G06F3/0482 , G06F3/04842 , G06F3/0488 , G06F16/248 , G06F16/29 , G06F16/487 , G06F16/9535 , G06F16/9537 , G06Q50/01 , G06T11/206 , G06T11/60 , H04L41/22 , H04L41/28 , H04L51/52 , H04L63/101 , H04L63/107 , H04L67/12 , H04L67/306 , H04L67/52 , H04L67/535 , H04W4/02 , H04W4/029 , H04W4/185 , H04W4/21 , H04W12/02 , G06F9/547 , G06T2200/24
Abstract: A map-based graphical user interface (GUI) for a public messaging platform allows a user location-based to their own expired ephemeral content. Such expired content is no longer available to other users for online viewing. The user can, however, switch the GUI between a live mode and a historical mode, access to their own expired content in the historical mode being facilitated in a manner closely similar to that for viewing live publicly available content.
-
-
-
-
-
-
-
-
-