公开(公告)号：US20240265658A1

公开(公告)日：2024-08-08

申请号：US18298217

申请日：2023-04-10

Applicant: Snap Inc.

Inventor： Maksym Bekuzarov ,  Andrii Didkivskyi ,  Sergei Korolev ,  Ihor Tymchyshyn

IPC: G06T19/20 ,  G06T19/00

CPC classification number: G06T19/20 ,  G06T19/006 ,  G06T2210/12 ,  G06T2210/22 ,  G06T2219/2012 ,  G06T2219/2021

Abstract: An extended Reality (XR) system provides methodologies for displaying virtual objects in a hand-centric XR experience. The XR system provides an XR user interface of an XR system to a user. The XR system captures video frame data of a hand of the user and detects the hand of the user based on the video frame data and a hand-detecting model. The XR system generates a cropping boundary box based on the detection of the hand and the video frame data and generates cropped video frame data based on the cropping boundary box and the video frame data. The XR system generates a 3D model of a portion of the hand of the user based on the cropped video frame data and a virtual object based on the 3D model of the portion of the hand of the user and a 3D texture. The XR displays the virtual object in the XR user interface.