公开(公告)号：US20190286892A1

公开(公告)日：2019-09-19

申请号：US15920027

申请日：2018-03-13

Applicant: Adobe Inc.

Inventor： Zimo Li ,  Vladimir Kim ,  Mehmet Ersin Yumer

IPC: G06K9/00 ,  G06K9/46 ,  G06T7/70 ,  G06N5/04

Abstract: Certain embodiments detect human-object interactions in image content. For example, human-object interaction metadata is applied to an input image, thereby identifying contact between a part of a depicted human and a part of a depicted object. Applying the human-object interaction metadata involves computing a joint-location heat map by applying a pose estimation subnet to the input image and a contact-point heat map by applying an object contact subnet to the to the input image. The human-object interaction metadata is generated by applying an interaction-detection subnet to the joint-location heat map and the contact-point heat map. The interaction-detection subnet is trained to identify an interaction based on joint-object contact pairs, where a joint-object contact pair includes a relationship between a human joint location and a contact point. An image search system or other computing system is provided with access to the input image having the human-object interaction metadata.

公开(公告)号：US20190259216A1

公开(公告)日：2019-08-22

申请号：US15900864

申请日：2018-02-21

Applicant: Adobe Inc.

Inventor： Emiliano Gambaretto ,  Vladimir Kim ,  Qingnan Zhou ,  Mehmet Ersin Yumer

IPC: G06T19/20 ,  G06T17/20

Abstract: Certain embodiments involve refining local parameterizations that apply two-dimensional (“2D”) images to three-dimensional (“3D”) models. For instance, a particular parameterization-initialization process is select based on one or more features of a target mesh region. An initial local parameterization for a 2D image is generated from this parameterization-initialization process. A quality metric for the initial local parameterization is computed, and the local parameterization is modified to improve the quality metric. The 3D model is modified by applying image points from the 2D image to the target mesh region in accordance with the modified local parameterization.