公开(公告)号：US20230360425A1

公开(公告)日：2023-11-09

申请号：US18298128

申请日：2023-04-10

Applicant: Samsung Electronics Co., Ltd.

Inventor： Dongfang Zhao ,  Yangwen Liang ,  Shuangquan Wang ,  Kee-Bong Song

IPC: G06V40/10 ,  G06V10/77 ,  G06V10/82 ,  G06T19/00

CPC classification number: G06V40/11 ,  G06V10/7715 ,  G06V10/82 ,  G06T19/006

Abstract: A method and device are disclosed for estimating an interaction with the device. The method includes configuring a first token and a second token of an estimation model according to first features of a 3D object, applying a first weight to the first token to produce a first-weighted input token and applying a second weight that is different from the first weight to the second token to produce a second-weighted input token, and generating, by a first encoder layer of an estimation-model encoder of the estimation model, an output token based on the first-weighted input token and the second-weighted input token. The method may include receiving, at a 2D feature extraction model, the first features from a backbone, extracting, by the 2D feature extraction model, second features including 2D features, and receiving, at the estimation-model encoder, data generated based on the 2D features.