公开(公告)号：US20240029382A1

公开(公告)日：2024-01-25

申请号：US18376607

申请日：2023-10-04

Applicant: Snap Inc.

Inventor： Daniel Monteiro Stoddart ,  Efstratios Skordos ,  Iason Kokkinos

IPC: G06T19/20 ,  G06V10/764 ,  G06V10/774 ,  G06V10/776 ,  G06T7/70 ,  G06T19/00 ,  G06T7/50

CPC classification number: G06T19/20 ,  G06V10/764 ,  G06V10/7747 ,  G06V10/776 ,  G06T7/70 ,  G06T19/006 ,  G06T7/50 ,  G06T2207/20084 ,  G06T2219/2016 ,  G06T2207/20228 ,  G06T2207/20081 ,  G06T2207/30196

Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including: receiving an image that includes a depiction of a first real-world body part in a real-world environment; applying a machine learning technique to the image to generate a plurality of dense outputs each associated with a respective pixel of a plurality of pixels in the image; applying a first task-specific decoder to the plurality of dense outputs to identify a pixel corresponding to a center of the first real-world body part; applying a second task-specific decoder using the identified pixel to retrieve a 3D rotation, translation and scale of first real-world body part from the plurality of dense outputs; modifying an AR object based on the 3D rotation, translation, and scale of first real-world body part; and modifying the image to include a depiction of the modified AR object.

公开(公告)号：US11823346B2

公开(公告)日：2023-11-21

申请号：US17690504

申请日：2022-03-09

Applicant: Snap Inc.

Inventor： Daniel Monteiro Stoddart ,  Efstratios Skordos ,  Iason Kokkinos

IPC: G06F9/30 ,  G06T19/20 ,  G06V10/764 ,  G06V10/774 ,  G06V10/776 ,  G06T7/70 ,  G06T19/00 ,  G06T7/50

CPC classification number: G06T19/20 ,  G06T7/50 ,  G06T7/70 ,  G06T19/006 ,  G06V10/764 ,  G06V10/776 ,  G06V10/7747 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20228 ,  G06T2207/30196 ,  G06T2219/2016

Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including: receiving an image that includes a depiction of a first real-world body part in a real-world environment; applying a machine learning technique to the image to generate a plurality of dense outputs each associated with a respective pixel of a plurality of pixels in the image; applying a first task-specific decoder to the plurality of dense outputs to identify a pixel corresponding to a center of the first real-world body part; applying a second task-specific decoder using the identified pixel to retrieve a 3D rotation, translation and scale of first real-world body part from the plurality of dense outputs; modifying an AR object based on the 3D rotation, translation, and scale of first real-world body part; and modifying the image to include a depiction of the modified AR object.

公开(公告)号：US12198287B2

公开(公告)日：2025-01-14

申请号：US18376607

申请日：2023-10-04

Applicant: Snap Inc.

Inventor： Daniel Monteiro Stoddart ,  Efstratios Skordos ,  Iason Kokkinos

IPC: G06T19/00 ,  G06T7/50 ,  G06T7/70 ,  G06T19/20 ,  G06V10/764 ,  G06V10/774 ,  G06V10/776

Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including: receiving an image that includes a depiction of a first real-world body part in a real-world environment; applying a machine learning technique to the image to generate a plurality of dense outputs each associated with a respective pixel of a plurality of pixels in the image; applying a first task-specific decoder to the plurality of dense outputs to identify a pixel corresponding to a center of the first real-world body part; applying a second task-specific decoder using the identified pixel to retrieve a 3D rotation, translation and scale of first real-world body part from the plurality of dense outputs; modifying an AR object based on the 3D rotation, translation, and scale of first real-world body part; and modifying the image to include a depiction of the modified AR object.

公开(公告)号：US20230230332A1

公开(公告)日：2023-07-20

申请号：US17690504

申请日：2022-03-09

Applicant: Snap Inc.

Inventor： Daniel Monteiro Stoddart ,  Efstratios Skordos ,  Iason Kokkinos

IPC: G06T19/20 ,  G06V10/764 ,  G06V10/774 ,  G06V10/776 ,  G06T7/70 ,  G06T7/50 ,  G06T19/00

CPC classification number: G06T19/20 ,  G06V10/764 ,  G06V10/7747 ,  G06V10/776 ,  G06T7/70 ,  G06T7/50 ,  G06T19/006 ,  G06T2219/2016 ,  G06T2207/20228 ,  G06T2207/20081 ,  G06T2207/30196 ,  G06T2207/20084

Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including: receiving an image that includes a depiction of a first real-world body part in a real-world environment; applying a machine learning technique to the image to generate a plurality of dense outputs each associated with a respective pixel of a plurality of pixels in the image; applying a first task-specific decoder to the plurality of dense outputs to identify a pixel corresponding to a center of the first real-world body part; applying a second task-specific decoder using the identified pixel to retrieve a 3D rotation, translation and scale of first real-world body part from the plurality of dense outputs; modifying an AR object based on the 3D rotation, translation, and scale of first real-world body part; and modifying the image to include a depiction of the modified AR object.