公开(公告)号：US20220334649A1

公开(公告)日：2022-10-20

申请号：US17719654

申请日：2022-04-13

Applicant: Snap Inc.

Inventor： Viktoria Hwang ,  Karen Stolzenberg

IPC: G06F3/01 ,  G06F3/04815 ,  G06F3/04817 ,  G06F3/0482 ,  G06V40/20 ,  G06V40/10 ,  G06V20/40 ,  G02B27/01

Abstract: Example systems, devices, media, and methods are described for controlling one or more virtual elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a hand and presents a menu icon on the display in accordance with a detected current hand location. The image processing system detects a series of hand shapes in the captured frames of video data and determines whether the detected hand shapes match any of a plurality of predefined hand gestures stored in a hand gesture library. In response to a match, the method includes executing an action in accordance with the matching hand gesture. In response to an opening gesture, an element animation system presents one or more graphical elements incrementally moving along a path extending away from the menu icon. A closing hand gesture causes the elements to retreat along the path toward the menu icon.

公开(公告)号：US11477366B2

公开(公告)日：2022-10-18

申请号：US16835990

申请日：2020-03-31

Applicant: Snap Inc.

Inventor： Jeremy Voss ,  Dallin Dyer

IPC: H04N5/232 ,  G06F3/0488 ,  G06V40/16 ,  H04L51/10

Abstract: A method for operating a messaging system for sending modifiable videos including a self-image of a user is provided. The method includes providing a face outline to assist with taking the self-image. Instructions relating to a light level, a facial expression, a face position, and a face size may be provided to the user. A smile measurement is displayed to enable the user to adjust the current smile level to a target smile level. A stock video may be created using an actor wearing a mask and facing a video camera. The mask is a marker for insertion of the self-image. The stock video is uploaded to a database of stock videos and, after selection by a user, is combined with a self-image to form a personalized video.

公开(公告)号：US20220327358A1

公开(公告)日：2022-10-13

申请号：US17808274

申请日：2022-06-22

Applicant: Snap Inc.

Inventor： Jacob Minyoung Huh ,  Shao-Hua Sun ,  Ning Zhang

IPC: G06N3/04 ,  G06V30/194 ,  G06N3/08

Abstract: Disclosed is a feedback adversarial learning framework, a recurrent framework for generative adversarial networks that can be widely adapted to not only stabilize training but also generate higher quality images. In some aspects, a discriminator's spatial outputs are distilled to improve generation quality. The disclosed embodiments model the discriminator into the generator, and the generator learns from its mistakes over time. In some aspects, a discriminator architecture encourages the model to be locally and globally consistent.

公开(公告)号：US11468615B2

公开(公告)日：2022-10-11

申请号：US17248956

申请日：2021-02-15

Applicant: Snap Inc.

Inventor： Rong Yan ,  Peter Sellis ,  Andrew G Cooper ,  Yantao Zheng

IPC: G06T11/60 ,  G06F3/04842 ,  H04N21/431 ,  H04N21/45 ,  H04N21/462 ,  H04L67/52 ,  G06F3/04845

Abstract: Systems and methods are presented that provide for receiving, at a media overlay publication system from a first client device, content to generate a media overlay, and generating the media overlay using the content received from the client device. The generated media overlay is stored in a database associated with the media overlay publication system and associated with a first characteristic of the content received from the first client device. The media overlay is provided to a second client device when a second characteristic of context data associated with the second client device correlates to the first characteristic for the media overlay, causing a display of the media overlay on a user interface of the second client device.

公开(公告)号：US20220321804A1

公开(公告)日：2022-10-06

申请号：US17706035

申请日：2022-03-28

Applicant: Snap Inc.

Inventor： Nikita Demidov ,  Roman Golobokov ,  Alina Melnyk ,  Jeremy Baker Voss

IPC: H04N5/272 ,  G06T19/00 ,  H04L51/52 ,  G06T11/60 ,  G06V40/16 ,  G06V10/82

Abstract: The subject technology receives at least one signal from a computing device, the at least one signal comprising at least one of a current time, battery power, sensor information, or location information. The subject technology generates a digital sticker, the digital sticker including graphical content indicating information based at least in part based on the at least one signal and media content including an image of a target face, the image of the target face being modified based on at least one of sets of source pose parameters to mimic at least one of positions of a head of a source actor and at least one of facial expressions of the source actor. The subject technology provides augmented reality content for display on a computing device, the augmented reality content including the digital sticker as an overlay on at least a portion of the augmented reality content.

公开(公告)号：US20220321374A1

公开(公告)日：2022-10-06

申请号：US17393204

申请日：2021-08-03

Applicant: Snap Inc.

Inventor： Andrew Cheng-min Lin ,  Walton Lin

IPC: H04L12/18

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for presenting an overview of participant conversations within a virtual conferencing system. The program and method provide for a virtual space comprising plural rooms, each room of the plural rooms being configured for virtual conferencing between respective participants; provide, for an administrator of the virtual space, display of a dashboard interface, the dashboard interface comprising a room preview element for each of the plural rooms, each room preview element corresponding to a live preview for a respective room of the plural rooms; determine metrics for each of the plural rooms; and provide for display of the metrics within the dashboard interface.

公开(公告)号：US20220321372A1

公开(公告)日：2022-10-06

申请号：US17390678

申请日：2021-07-30

Applicant: Snap Inc.

Inventor： Emily Cho ,  Andrew Cheng-min Lin ,  Walton Lin

IPC: H04L12/18 ,  G06T19/20 ,  G06T19/00

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for updating element properties based on distances between elements in a virtual conference. The program and method provide, in association with designing a room, an interface for specifying how a first element in the room affects at least one property value of a second element, based on distance between the two elements; receive user selection of parameter values specifying how the first element affects the at least one property value of the second element based on the distance; provide a virtual conference between plural participants within the room including the first and second elements; update the at least one property value of the second element based on a change in distance between the first and second elements, and on the parameter values; and provide for updated display of the second element.

公开(公告)号：US20220319364A1

公开(公告)日：2022-10-06

申请号：US17697005

申请日：2022-03-17

Applicant: Snap Inc.

Inventor： Jason Heger ,  Gerald Nilles

IPC: G09G3/00 ,  G09G3/34 ,  G02B27/01

Abstract: Eyewear including a projector having a variable feedback loop controlling a forward current delivered to a colored light source. The colored light source is configured to generate a colored light beam to generate a displayed image. The variable feedback loop in one example has a variable resistance to selectively generate a high brightness image when the eyewear is operated outside, or in a high ambient light setting, and to selectively generate a nominal brightness image when the eyewear is operated inside. A controller selectively controls the drive current delivered to the colored light source to control the brightness mode of the image.

公开(公告)号：US20220319231A1

公开(公告)日：2022-10-06

申请号：US17709711

申请日：2022-03-31

Applicant: Snap Inc.

Inventor： Alexey Pankov ,  Pavel Savchenkov

IPC: G06V40/16 ,  G06T17/20 ,  G06T19/20 ,  G06T7/10 ,  G06V10/82 ,  G06T3/00

Abstract: The subject technology receives frames of a source media content, the frames of the source media content including representations of a head and a face of a source actor. The subject technology generates, based at least in part on the frames of the source media content, sets of source pose parameters. The subject technology receives at least one target image, the at least one target image including representations of a target head and a target face of a target entity. The subject technology provides the sets of source pose parameters to a neural network to determine facial landmarks for head turns and facial expressions. The subject technology generates, based at least in part on the sets of source pose parameters and the facial landmarks for head turns and facial expressions, an output media content. The subject technology provides augmented reality content based at least in part on the output media content for display on a computing device.

公开(公告)号：US20220319127A1

公开(公告)日：2022-10-06

申请号：US17708744

申请日：2022-03-30

Applicant: Snap Inc.

Inventor： Grigoriy Tkachenko ,  Inna Zaitseva

IPC: G06T19/00 ,  G06T7/70 ,  G06V40/16 ,  G06F3/0482

Abstract: The subject technology receives a selection of a selectable graphical item to initiate generating augment reality content including facial synthesis, the selection being received by a third party application, the third party application being executed by a computing device separate from a first party application and a messaging server system. The subject technology captures image data by the client device. The subject technology generates, by the one or more hardware processors and based at least in part on frames of a source media content, sets of source pose parameters. The subject technology generates, based at least in part on sets of the source pose parameters, an output media content using an interface communicating with the messaging server system. The subject technology provides augmented reality content based at least in part on the output media content for display on the computing device.