Invention Application
- Patent Title: BODY POSE ESTIMATION USING SELF-TRACKED CONTROLLERS
-
Application No.: PCT/US2022/031494Application Date: 2022-05-30
-
Publication No.: WO2022271415A1Publication Date: 2022-12-29
- Inventor: BOSWORTH, Andrew Garrod
- Applicant: META PLATFORMS TECHNOLOGIES, LLC
- Applicant Address: c/o Rimon Law/Steven Colby
- Assignee: META PLATFORMS TECHNOLOGIES, LLC
- Current Assignee: META PLATFORMS TECHNOLOGIES, LLC
- Current Assignee Address: c/o Rimon Law/Steven Colby
- Agency: COLBY, Steven et al.
- Priority: US17/353,696 2021-06-21
- Main IPC: G06F3/01
- IPC: G06F3/01 ; G02B27/00 ; G02B27/01 ; G06F3/03 ; G06F3/0346 ; G06N3/02 ; G06N3/04 ; G06T7/70 ; G06T7/73 ; G06T17/00 ; G06T19/00 ; G06V40/20 ; G02B2027/0138 ; G02B2027/0178 ; G02B27/0093 ; G02B27/017 ; G06F3/011 ; G06F3/012 ; G06F3/0304 ; G06N3/049 ; G06N3/08 ; G06N3/09 ; G06T13/40 ; G06T2207/10024 ; G06T2207/10028 ; G06T2207/10048 ; G06T2207/20081 ; G06T2207/20084 ; G06T2207/30196 ; G06T2207/30244 ; G06T7/246 ; G06T7/292 ; G06V10/82 ; G06V40/103
Abstract:
In one embodiment, a computing system may determine a pose of a controller held by a user based on sensor data captured by the controller. The system may determine positions of a first set of keypoints associated with a first portion of a body of the user based on images captured by the controller cameras and (2) the controller pose. The system may determine a pose of a headset worn by the user based on sensor data captured by the headset. The system may determine positions of a second set of keypoints associated with a second portion of the body of the user based on images captured by the headset cameras and (2) the pose of the headset. The system may determine a full body pose of the user based at least on the positions of the first set and the second set of keypoints.
Information query
