公开(公告)号：US11232294B1

公开(公告)日：2022-01-25

申请号：US15717792

申请日：2017-09-27

Applicant: Amazon Technologies, Inc.

Inventor： Prithviraj Banerjee ,  Leonid Pishchulin ,  Jean Laurent Guigues ,  Gerard Guy Medioni

IPC: G06K9/00 ,  G06K9/46 ,  G06K9/62 ,  H04N7/18 ,  G06T7/73

Abstract: Actors may be detected and tracked within a scene using multiple imaging devices provided in a network that are aligned with fields of view that overlap at least in part. Processors operating on the imaging devices may evaluate the images using one or more classifiers to recognize body parts within the images, and to associate the body parts with a common actor within the scene. Each of the imaging devices may generate records of the positions of the body parts and provide such records to a central server, that may correlate body parts appearing within images captured by two or more of the imaging devices and generate a three-dimensional model of an actor based on positions of the body parts. Motion of the body parts may be tracked in subsequent images, and the model of the actor may be updated based on the motion.

公开(公告)号：US11625838B1

公开(公告)日：2023-04-11

申请号：US17218476

申请日：2021-03-31

Applicant: Amazon Technologies, Inc.

Inventor： Dinesh Reddy Narapureddy ,  Jean Laurent Guigues ,  Leonid Pishchulin ,  Jayakrishnan Kumar Eledath

IPC: G06T7/246 ,  G06T7/73 ,  G06K9/62 ,  G06N3/02 ,  G06V10/40 ,  G06V40/10

Abstract: Devices and techniques are generally described for articulated three-dimensional pose tracking. In some examples, a plurality of frames of image data captured by one or more cameras may be received. First feature data representing the plurality of frames of image data may be determined using a backbone network. The first feature data may be projected into three-dimensional (3D) space. In some examples, 3D location data describing respective 3D locations of one or more persons represented by the first feature data projected in the 3D space may be determined. The first feature data and the 3D location data may be sent to a four-dimensional (4D) convolutional neural network (CNN). The 4D CNN may generate second feature data comprising respective 3D representations of the one or more persons. Three dimensional pose data representing articulated 3D pose information for the one or more persons may be generated.

公开(公告)号：US12026619B1

公开(公告)日：2024-07-02

申请号：US16710951

申请日：2019-12-11

Applicant: Amazon Technologies, Inc.

Inventor： Maxim Berman ,  Leonid Pishchulin ,  Ning Xu ,  Gerard Guy Medioni

IPC: G06N3/082 ,  G06F11/30 ,  G06N3/04

CPC classification number: G06N3/082 ,  G06F11/3058 ,  G06N3/04

Abstract: Disclosed are systems and methods to perform neural architecture search (“NAS”) that automatically optimizes for the number of channels to allocate to each layer of a deep neural network. Some implementations include a pairwise slimming that includes a global optimization step. Likewise, in some implementations, a bias toward a region of interest may be applied to channel path selection during training.

公开(公告)号：US11861927B1

公开(公告)日：2024-01-02

申请号：US17582985

申请日：2022-01-24

Applicant: Amazon Technologies, Inc.

Inventor： Prithviraj Banerjee ,  Leonid Pishchulin ,  Jean Laurent Guigues ,  Gerard Guy Medioni

IPC: G06V40/10 ,  G06V10/426 ,  G06V20/52 ,  G06F18/2411 ,  G06F18/2415 ,  H04N7/18 ,  G06T7/73 ,  G06V10/56 ,  G06V10/75

CPC classification number: G06V40/10 ,  G06F18/2411 ,  G06F18/2415 ,  G06V10/426 ,  G06V20/52 ,  G06T7/74 ,  G06V10/56 ,  G06V10/751 ,  H04N7/181

Abstract: Actors may be detected and tracked within a scene using multiple imaging devices provided in a network that are aligned with fields of view that overlap at least in part. Processors operating on the imaging devices may evaluate the images using one or more classifiers to recognize body parts within the images, and to associate the body parts with a common actor within the scene. Each of the imaging devices may generate records of the positions of the body parts and provide such records to a central server, that may correlate body parts appearing within images captured by two or more of the imaging devices and generate a three-dimensional model of an actor based on positions of the body parts. Motion of the body parts may be tracked in subsequent images, and the model of the actor may be updated based on the motion.

公开(公告)号：US11783613B1

公开(公告)日：2023-10-10

申请号：US17098878

申请日：2020-11-16

Applicant: Amazon Technologies, Inc.

Inventor： Jean Laurent Guigues ,  Leonid Pishchulin

IPC: G06V40/10 ,  G06T7/77 ,  H04N7/18 ,  G06V10/46 ,  G06F18/2113 ,  G06F18/2415 ,  G06T7/292 ,  G06V20/52 ,  G06F18/214

CPC classification number: G06V40/10 ,  G06F18/214 ,  G06F18/2113 ,  G06F18/2415 ,  G06T7/292 ,  G06T7/77 ,  G06V10/469 ,  G06V20/52 ,  H04N7/181 ,  G06T2207/20044 ,  G06T2207/30232 ,  G06T2207/30241

Abstract: Poses or gestures of actors within a scene may be detected and tracked using multiple imaging devices aligned with fields of view that overlap at least in part. Images captured by the imaging devices may be synchronized and provided to a classifier to recognize body parts within the images, and score maps indicative of locations of peak probabilities that the images include the respective body parts may be generated. Locations of peak values within the score maps may be correlated with one another to confirm that a given body part is depicted in two or more fields of view, and vectors indicative of distances to or ranges of motion of body parts, with respect to the given body part, may be generated. Motion of the body parts may be tracked in subsequent images, and a virtual model of the body parts may be generated and updated based on the motion.