公开(公告)号：WO2022031478A1

公开(公告)日：2022-02-10

申请号：PCT/US2021/043345

申请日：2021-07-27

Applicant: FACEBOOK TECHNOLOGIES, LLC

Inventor： FORSTER, Christian ,  YAN, Chengyuan ,  YU, Tsz Ho

IPC: G06F3/01 ,  G06F3/03 ,  G06F3/0346 ,  G06F3/011 ,  G06F3/012 ,  G06F3/017 ,  G06F3/0304 ,  G06K9/6289 ,  G06V20/10 ,  G06V40/28

Abstract: In one embodiment, a method includes capturing, using one or more cameras implemented in a wearable device worn by a user, a first image depicting at least a part of a hand of the user holding a controller in an environment, identifying one or more features from the first image to estimate a pose of the hand of the user, estimating a first pose of the controller based on the pose of the hand of the user and an estimated grip that defines a relative pose between the hand of the user and the controller, receiving IMU data of the controller, and estimating a second pose of the controller by updating the first pose of the controller using the IMU data of the controller. The method utilizes multiple data sources to track the controller under various conditions of the environment to provide an accurate controller tracking consistently.

公开(公告)号：WO2020009710A1

公开(公告)日：2020-01-09

申请号：PCT/US2018/041329

申请日：2018-07-09

Applicant: FACEBOOK TECHNOLOGIES, LLC

Inventor： LINDE, Oskar ,  FORSTER, Christian

IPC: G06T1/20 ,  G06T7/20 ,  G02B27/01

Abstract: The disclosed computer-implemented method for offloading image-based tracking operations from a general processing unit to a hardware accelerator unit may include (1) sending imaging data from an imaging device to a hardware accelerator unit, and (2) directing the hardware accelerator unit to generate a multi-scale representation of the imaging data sent from the imaging device, (3) preparing a set of input data for a set of image-based tracking operations, and (4) directing the hardware accelerator unit to execute the set of image-based tracking operations using the generated multi-scale representation of the imaging data and the prepared set of input data. Various other methods, systems, and computer-readable media are also disclosed.