HUMAN POSE RECOGNITION USING ABSTRACT IMAGES AND VIEWPOINT/POSE ENCODING

    公开(公告)号:US20240428456A1

    公开(公告)日:2024-12-26

    申请号:US18749898

    申请日:2024-06-21

    Abstract: A device receives a real image (e.g., photograph or video frame) that includes a human. The device creates a synthetic image corresponding to the real image. The synthetic image includes a synthetic environment and a humanoid shape that correspond to the human. The device predicts, using a trained viewpoint neural network and based on the synthetic image, a predicted viewpoint heatmap. The device predicts, using a trained pose neural network and based on the synthetic image, a predicted pose heatmap. The device provides, as input to a random synthetic environment, the predicted viewpoint heatmap and the predicted pose heatmap and creates a reconstructed three-dimensional pose based on the predicted viewpoint heatmap, the predicted pose heatmap, and the random synthetic environment. The device classifies the reconstructed three-dimensional pose as a particular type of pose of the human in the real image.

Patent Agency Ranking