-
公开(公告)号:US20240428456A1
公开(公告)日:2024-12-26
申请号:US18749898
申请日:2024-06-21
Applicant: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA
Inventor: Saad Manzur , Wayne Brian HAYES
Abstract: A device receives a real image (e.g., photograph or video frame) that includes a human. The device creates a synthetic image corresponding to the real image. The synthetic image includes a synthetic environment and a humanoid shape that correspond to the human. The device predicts, using a trained viewpoint neural network and based on the synthetic image, a predicted viewpoint heatmap. The device predicts, using a trained pose neural network and based on the synthetic image, a predicted pose heatmap. The device provides, as input to a random synthetic environment, the predicted viewpoint heatmap and the predicted pose heatmap and creates a reconstructed three-dimensional pose based on the predicted viewpoint heatmap, the predicted pose heatmap, and the random synthetic environment. The device classifies the reconstructed three-dimensional pose as a particular type of pose of the human in the real image.