公开(公告)号：US20230316665A1

公开(公告)日：2023-10-05

申请号：US17841994

申请日：2022-06-16

Applicant: Snap Inc.

Inventor： Madiyar Aitbayev ,  Brian Fulkerson ,  Riza Alp Guler ,  Georgios Papandreou ,  Himmy Tam

IPC: G06T19/00 ,  G06T7/11 ,  G06T7/194 ,  G06T15/50 ,  G06T7/70 ,  G06T19/20 ,  G06T15/60

CPC classification number: G06T19/006 ,  G06T7/11 ,  G06T7/194 ,  G06T15/506 ,  G06T7/70 ,  G06T19/20 ,  G06T15/60 ,  G06T2207/30196 ,  G06T2207/20021 ,  G06T2207/20081 ,  G06T2207/10016 ,  G06T2219/2012 ,  G06T2207/20084 ,  G06T2200/08 ,  G06T2210/16

Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a person depicted in an image. The operations include receiving an image that includes data representing a depiction of a person; generating a segmentation of the data representing the person depicted in the image; extracting a portion of the image corresponding to the segmentation of the data representing the person depicted in the image; applying a machine learning model to the portion of the image to predict a surface normal tensor for the data representing the depiction of the person, the surface normal tensor representing surface normals of each pixel within the portion of the image; and applying one or more augmented reality (AR) elements to the image based on the surface normal tensor.