公开(公告)号：US11380051B2

公开(公告)日：2022-07-05

申请号：US17248833

申请日：2021-02-10

Applicant: Snap Inc.

Inventor： Nathan Jurgenson ,  Linjie Luo ,  Jonathan M Rodriguez, II ,  Rahul Sheth ,  Jia Li ,  Xutao Lv

IPC: G06T17/00 ,  G06T19/00

Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. Point cloud data describing an environment is then accessed. A two-dimensional surface of an image of an environment is captured, and a portion of the image is matched to a portion of key points in the point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.

公开(公告)号：US20220207875A1

公开(公告)日：2022-06-30

申请号：US17550852

申请日：2021-12-14

Applicant: Snap Inc.

Inventor： Kavya Venkata Kota Kopparapu ,  Benjamin Dodson ,  Francesc Xavier Drudis Rius ,  Angus Kong ,  Richard Leider ,  Jian Ren ,  Sergey Tulyakov ,  Jiayao Yu

IPC: G06V20/40 ,  G06N20/00 ,  G06T5/00 ,  G06V10/70 ,  G06V20/70 ,  G06F16/783

Abstract: Aspects of the present disclosure involve a system comprising a medium storing a program and method for machine-learning based selection of a representative video frame. The program and method provide for receiving a set of video frames; determining a first subset of frames by removing frames outside of an image quality threshold; determining a second subset by removing frames outside of an image stillness threshold; computing feature data for each frame in the second subset; providing, for each frame in the second subset, the feature data to a machine learning model (MLM), the MLM being configured to output a score for each frame in the second subset of frames based on the feature data, the MLM having been trained with a first set of images labeled based on aesthetics, and with a second set of images labeled based on image quality; and selecting a frame based on output scores.

公开(公告)号：US20220207812A1

公开(公告)日：2022-06-30

申请号：US17697559

申请日：2022-03-17

Applicant: Snap Inc.

Inventor： Alexander Mashrabov ,  Victor Shaburov ,  Sofia Savinova ,  Dmitriy Matov ,  Andrew Osipov ,  Ivan Semenov ,  Roman Golobokov

IPC: G06T13/80 ,  H04L51/04 ,  G11B27/031 ,  H04L51/10

Abstract: Described are systems and methods for generating personalized videos with customized text messages. An example method commences with receiving an input text and a video template. The video template includes a sequence of frame images and text parameters defining an animation of the input text for the sequence of frame images. The method continues with rendering an output video. The output video includes the sequence of frame images featuring the input text rendered according to the text parameters. The method further includes providing a user with an option to change at least one text parameter of the text parameters. The method continues with dynamically changing, by the at least one computing resource, the input text according to the at least one text parameter. The method further includes providing, by the at least one computing resource, the output video to at least one further computing resource via a communication chat.

公开(公告)号：US20220206738A1

公开(公告)日：2022-06-30

申请号：US17556802

申请日：2021-12-20

Applicant: Snap Inc.

Inventor： Kaveh Anvaripour ,  Christine Barron ,  Wayne Mike Cao ,  Andrew Grosvenor Cooper ,  Christie Marie Heikkinen ,  Ranidu Lankage

IPC: G06F3/16 ,  H04N21/439 ,  G11B27/031

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing audio with captured video clips. The program and method provide for displaying, by a messaging application, a capture user interface for capturing video; providing a camera mode selection element which is selectable to switch between a first camera mode for capturing a single video clip and a second camera mode for capturing multiple video clips, to generate a media content item; providing an audio selection element which is selectable to select an audio track for the media content item; receiving, via the camera mode selection element, first user input selecting the second camera mode; receiving, via the audio selection element, second user input selecting the audio track; and providing for capturing multiple video clips in association with the selected audio track for generating the media content item.

公开(公告)号：US20220206582A1

公开(公告)日：2022-06-30

申请号：US17646360

申请日：2021-12-29

Applicant: Snap Inc.

Inventor： Alexander P. Powell ,  Mark Thomas

IPC: G06F3/01 ,  G06F3/04883 ,  H04N5/272

Abstract: Method for generating haptic feedback responses using haptic augmentations starts with processor receiving a media content item from a first client device and receiving from the first client device a selection of a haptic overlay associated with a haptic feedback response to be applied to the media content item. The processor generates a modified media content item by overlaying the haptic overlay on the media content item. The processor receives from the first client device a selection of a second user associated with the second user and causes the modified media content item to be displayed by a second user interface of the second client device. The processor detects a selection of the haptic overlay from the second client device, and in response to detecting the selection of the haptic overlay, causing the second user interface to generate the haptic feedback response. Other embodiments are described herein.

公开(公告)号：US20220198026A1

公开(公告)日：2022-06-23

申请号：US17133337

申请日：2020-12-23

Applicant: Snap Inc.

Inventor： Christine Barron ,  Laurent Desserrey ,  Daniel Moreno ,  Celia Nicole Mourkogiannis ,  David Phillip Taitz ,  Christie Marie Heikkinen

IPC: G06F21/60 ,  H04L12/58

Abstract: A permission based media system to perform operations that include: presenting a first media object at a client device associated with a user account, the first media object including a reference that identifies the user account; receiving an input that selects the first media object from the client device; determining a permission of the user account based on the reference that identifies the user account; presenting a set of options based on the permission associated with the user account; receiving a selection of an option from among the set of options; and generating a second media object based on the first media object and the selection of the option, according to certain embodiments.

公开(公告)号：US20220197393A1

公开(公告)日：2022-06-23

申请号：US17410787

申请日：2021-08-24

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06F3/01 ,  G06F3/0485 ,  G06F3/0484 ,  G06F3/0482 ,  G06F3/0481

Abstract: Systems and methods are provided for performing operations comprising: displaying one or more virtual objects on an eyewear device; detecting, by a camera of the eyewear device, a hand within view of the eyewear device; determining that a first finger of the hand is oriented along a same direction as the one or more virtual objects that are displayed; detecting movement of a second finger of the hand relative to the first finger; and controlling the display of the one or more virtual objects in response to detecting movement of the second finger to the first finger.

公开(公告)号：US20220197027A1

公开(公告)日：2022-06-23

申请号：US17445772

申请日：2021-08-24

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Andrew James McPhee ,  Daniel Moreno

IPC: G02B27/01 ,  G06F3/01 ,  G06F3/0481 ,  H04L12/58

Abstract: Systems and methods are provided for performing operations comprising: receiving a request to access a conversation interface; in response to receiving the request, retrieving a plurality of virtual conversation objects associated with the conversation interface; displaying a first virtual conversation object of the plurality of virtual conversation objects at a first location in three-dimensional space; determining that a second virtual conversation object of the plurality of virtual conversation objects is associated with an earlier timestamp than the first virtual conversation object; and in response to determining that the second virtual conversation object is associated with the earlier timestamp than the first virtual conversation object, displaying the second virtual conversation object at a second location in three-dimensional space that is closer to a user of an eyewear device than the first location.

公开(公告)号：US20220192622A1

公开(公告)日：2022-06-23

申请号：US17456096

申请日：2021-11-22

Applicant: Snap Inc.

Inventor： Ashwani Arya ,  Tejas Bahulkar

IPC: A61B7/00 ,  H04R1/40 ,  A61B5/00 ,  A61B5/08 ,  G16H20/40 ,  G16H50/20

Abstract: Disclosed is a of monitoring the breathing of a user, comprising receiving a plurality of audio signals from a plurality of microphones and beamforming the plurality of audio signals into a beamformed audio signal. Observed breath-related parameters are derived from the beamformed audio signal and an output of or derived from the observed breath-related parameters is provided to a user of a client device. Breath metrics may be determined by comparing the observed breath-related parameters with reference breath-related parameters, and a breathing score may be derived from the breath metrics. The breathing score may be based on a combination of how closely an observed respiration of the user matches a prompted or desired respiration rate and an observed amount of time that the user's observed respiration rate is within a threshold value of the prompted or desired respiration rate.

公开(公告)号：US11367234B2

公开(公告)日：2022-06-21

申请号：US17165639

申请日：2021-02-02

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Andrés Monroy-Hernández ,  Rajan Vaish

IPC: G06T11/60 ,  G06T19/00 ,  G06T11/00

Abstract: A server machine modifies an augmented reality (AR) object in response to fulfillment of a condition. The machine provides, to a user device, object data that defines the AR object. The object data specifies a physical geolocation of the AR object, a presentation attribute of the AR object, a conditional modification program, and a trigger condition for execution of the conditional modification program. The object data causes the user device to present the AR object with a first appearance, located at the physical geolocation. The machine detects fulfillment of the trigger condition, and in response, the machine executes the conditional modification program. This modifies the object data by modifying the presentation attribute. The machine provides, to the user device, the modified object data, which causes the user device to present the AR object with a second appearance based on the modified presentation attribute.