公开(公告)号：US20220086111A1

公开(公告)日：2022-03-17

申请号：US17477359

申请日：2021-09-16

Applicant: Snap Inc.

Inventor： Brian Anthony Smith ,  Yu Jiang Tham ,  Rajan Vaish

IPC: H04L12/58 ,  G06T19/00

Abstract: Systems and methods herein describe generating automatic reactions in an augmented reality messenger system. The claimed systems and methods generate a contextual trigger defining a set of conditions at a first computing device, detect at least one of the set of conditions has been satisfied, cause presentation of an augmented reality content item at a second computing device, generate a user reaction in response to the presentation of the augmented reality content item and transmit the user reaction to a first computing device.

公开(公告)号：US20210306387A1

公开(公告)日：2021-09-30

申请号：US17207174

申请日：2021-03-19

Applicant: Snap Inc.

Inventor： Brian Anthony Smith ,  Yu Jiang Tham ,  Rajan Vaish

IPC: H04L29/06 ,  G06T19/00 ,  G02B27/01

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, method, and user interface to facilitate augmented reality based communication between multiple users over a network. Session configuration data including configuration parameters of a virtual interaction session with a first user is received from a first device. The configuration parameters include an identifier of a second user that is permitted to join the virtual interaction session and a micro-chat duration that defines a time limit for a real-time communication link between the first and second user during the virtual interaction session. The real-time communication link between the first and second user by causing display, by the second device, of a live camera feed generated at the first device. Upon expiration of the micro-chat duration, the real-time communication link between the first and second user is terminated.

公开(公告)号：US20210304450A1

公开(公告)日：2021-09-30

申请号：US17206991

申请日：2021-03-19

Applicant: Snap Inc.

Inventor： Brian Anthony Smith ,  Yu Jiang Tham ,  Rajan Vaish

IPC: G06T11/00 ,  G06F3/14 ,  G02B27/01

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, method, and user interface to facilitate augmented reality based communication between multiple users over a network. Input data is received from a first device that is indicative of a selection by a first user of virtual content item to apply to a real-world environment that is visible to a second user via a second device. The virtual content item may comprise one or more media objects. Based on receiving the input data, the second device is caused to present the one or more media objects overlaid on the real-world environment that is visible to the second user via the second device.

公开(公告)号：US20210105397A1

公开(公告)日：2021-04-08

申请号：US17125298

申请日：2020-12-17

Applicant: Snap Inc.

Inventor： Brian Anthony Smith ,  Rajan Vaish

IPC: H04N5/232 ,  H04L29/06 ,  H04N1/00

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, method, and user interface to facilitate a camera sharing session between two or more users. A camera sharing session is initiated based on session configuration information comprising a user identifier of a user permitted to control image capturing at a camera communicatively coupled to a first device. A trigger request is received from the second device and in response, an image capture, which results in at least one image, is triggered at the camera and the image is transmitted to the second device.

公开(公告)号：US12169905B2

公开(公告)日：2024-12-17

申请号：US18507293

申请日：2023-11-13

Applicant: Snap Inc.

Inventor： Fannie Liu ,  Rajan Vaish

IPC: G06T19/00 ,  G06F3/04842 ,  G06F3/04845 ,  G08B5/22 ,  H04N5/91

Abstract: Systems and methods enable users to engage in meaningful, authentic, online interactions by extracting objects (virtual or real) from an image or video and transferring the extracted objects into a real-world environment of another user in three-dimensional augmented reality. An object to be sent from the first user to the second user is generated using a drawing application, extracted from an image or a video, or an AR object is captured. A video is recorded showing the object responding to an action of the first user and metadata is generated relating to the response of the object to the action of the first user. The video and metadata are sent to the second user. Upon receipt, the video is watched by the second user and the object is selected for presentation in a display environment of the second user. The state of the object is preserved by the metadata.

公开(公告)号：US12154230B2

公开(公告)日：2024-11-26

申请号：US17470546

申请日：2021-09-09

Applicant: Snap Inc.

Inventor： Brian Anthony Smith ,  Yu Jiang Tham ,  Rajan Vaish

IPC: G06T19/00 ,  G06V40/16 ,  H04L51/10 ,  H04L51/222

Abstract: Systems and methods herein describe an augmented reality messenger system. The proposed systems and methods generate an augmented reality content item based on input from a first computing device, generate a contextual trigger for the generated augmented reality content, the contextual trigger defining a set of conditions for presenting the generated augmented reality content item on a second computing device, and cause presentation of the generated augmented reality content item on the second computing device based on at least one condition of the set of conditions being satisfied.

公开(公告)号：US11972521B2

公开(公告)日：2024-04-30

申请号：US17899970

申请日：2022-08-31

Applicant: Snap Inc.

Inventor： Rajan Vaish ,  Sven Kratz ,  Andrés Monroy-Hernández ,  Brian Anthony Smith

IPC: G06T15/08 ,  G06F3/04815

CPC classification number: G06T15/08 ,  G06F3/04815

Abstract: Input indicative of a selection of volumetric content for presentation is received. The volumetric content comprises a volumetric representation of one or more elements of a real-world three-dimensional space. In response to the input, device state data associated with the volumetric content is accessed. The device state data describes a state of one or more network-connected devices associated with the real-world three-dimensional space. The volumetric content is presented. The presentation of the volumetric content includes presentation of the volumetric representation of the one or more elements overlaid on the real-world three-dimensional space by a display device and configuring the one or more network-connected devices using the device state data.

公开(公告)号：US11935198B2

公开(公告)日：2024-03-19

申请号：US17362431

申请日：2021-06-29

Applicant: Snap Inc.

Inventor： Rajan Vaish ,  Yu Jiang Tham ,  Brian Anthony Smith ,  Sven Kratz ,  Karen Stolzenberg ,  David Meisenholder

IPC: G06T7/00 ,  G06T13/80 ,  G06T19/00 ,  H04L51/046 ,  H04L51/216 ,  H04L51/222

CPC classification number: G06T19/006 ,  G06T7/00 ,  G06T13/80 ,  H04L51/046 ,  H04L51/216 ,  H04L51/222 ,  G06T2207/30204

Abstract: A virtual mailbox is established for a first user based on a virtual mailbox definition specified by the first user. A message directed to the first user is received from a first device associated with a second user. A location within a real-world environment of the first user corresponding to the virtual mailbox is identified. A marker associated with the virtual mailbox is detected within the real-world environment of the first user. Based on detecting the marker, the second device presents the message overlaid on the real-world environment at the location corresponding to the virtual mailbox.

公开(公告)号：US20240073402A1

公开(公告)日：2024-02-29

申请号：US17900200

申请日：2022-08-31

Applicant: Snap Inc.

Inventor： Rajan Vaish ,  Sven Kratz ,  Andrés Monroy-Hernández ,  Brian Anthony Smith

IPC: H04N13/368 ,  G06T19/00 ,  H04N13/106 ,  H04N13/117 ,  H04N13/189 ,  H04N13/388

CPC classification number: H04N13/368 ,  G06T19/006 ,  H04N13/117 ,  H04N13/158 ,  H04N13/189 ,  H04N13/388 ,  G06T2219/024

Abstract: The present disclosure relates to methods and systems for providing a multi-perspective augmented reality experience. A volumetric video of a three-dimensional space is captured. The volumetric video of the three-dimensional space includes a volumetric representation of a first user within the three-dimensional space. The volumetric video is displayed by a display device worn by a second user, and the second user sees the volumetric representation of the first user within the three-dimensional space. Input indicative of an interaction (e.g., entering or leaving) of the second user with the volumetric representation of the first user is detected. Based on detecting the input indicative of the interaction, the display device switches to a display of a recorded perspective of the first user. Thus, by interacting with a volumetric representation of the first user in a volumetric video, the second user views the first user's perspective of the three-dimensional space.

公开(公告)号：US20240071006A1

公开(公告)日：2024-02-29

申请号：US18058175

申请日：2022-11-22

Applicant: Snap Inc.

Inventor： Sven Kratz ,  Andrés Monroy-Hernández ,  Brian Anthony Smith ,  Rajan Vaish

IPC: G06T19/00 ,  G06F3/04815

CPC classification number: G06T19/006 ,  G06F3/04815

Abstract: A volumetric content presentation system includes a head-worn display device, which includes one or more processors, and a memory storing instructions that, when executed by the one or more processors, configure the display device to access AR content items that correspond to either real-world objects or virtual objects, mix and match these AR content items, and present volumetric content that includes these mixed and matched AR content items overlaid on a real-world environment to create a new AR scene that a user can experience.