-
公开(公告)号:US11657595B1
公开(公告)日:2023-05-23
申请号:US17170722
申请日:2021-02-08
Applicant: Amazon Technologies, Inc.
Inventor: Samuel Nathan Hallman , Petko Tsonev , Michael Francis O'Malley , Jayakrishnan Eledath , Jue Wang , Tian Lan
CPC classification number: G06V10/751 , G06N3/08 , G06T5/50 , G06V20/647 , G06V40/10 , G06T2207/10028
Abstract: An imaging device may capture images of a scene, where the scene includes retroreflective materials. Where visual images and depth images are captured from a scene, and the depth images have ratios of supersaturated pixels that are less than a predetermined threshold, a location map of the scene is generated or updated based on the depth images. Where the ratios are greater than the predetermined threshold, the location map of the scene is generated or updated based on the visual images. Additionally, where each of a plurality of imaging devices detect concentrations of supersaturated pixels beyond a predetermined threshold or limit within their respective fields of view, an actor present on the scene may be determined to be wearing retroreflective material, or otherwise designated as a source of the supersaturation, and tracked with the scene based on coverage areas that are determined to have excessive ratios of supersaturated pixels.
-
公开(公告)号:US11443516B1
公开(公告)日:2022-09-13
申请号:US16841289
申请日:2020-04-06
Applicant: Amazon Technologies, Inc.
Inventor: Samuel Nathan Hallman , Tian Lan , Hui Liang , Gerard Guy Medioni , Kostia Robert
Abstract: Motion of actors within a scene may be detected based on imaging data, using machine learning tools operating on cameras that captured the imaging data. The machine learning tools process images to perform a number of tasks, including detecting heads of actors, and sets of pixels corresponding to the actors, before constructing line segments from the heads of the actors to floor surfaces on which the actors stand or walk. The line segments are aligned along lines extending from locations of heads within an image to a vanishing point of a camera that captured the image. Trajectories of actors and visual data are transferred from the cameras to a central server, which links trajectories captured by multiple cameras and locates detected actors throughout the scene, even when the actors are not detected within a field of view of at least one camera.
-
公开(公告)号:US11386306B1
公开(公告)日:2022-07-12
申请号:US16219870
申请日:2018-12-13
Applicant: Amazon Technologies, Inc.
Inventor: Behjat Siddiquie , Tian Lan , Jayakrishnan Eledath , Hoi Cheung Pang
Abstract: As agents move about a materials handling facility, tracklets representative of the position of each agent are maintained along with a confidence score indicating a confidence that the position of the agent is known. If the confidence score falls below a threshold level, image data of the agent associated with the low confidence score is obtained and processed to generate one or more embedding vectors representative of the agent at a current position. Those embedding vectors are then compared with embedding vectors of other candidate agents to determine a set of embedding vectors having a highest similarity. The candidate agent represented by the set of embedding vectors having the highest similarity score is determined to be the agent and the position of that candidate agent is updated to the current position, thereby re-identifying the agent.
-
公开(公告)号:US12131539B1
公开(公告)日:2024-10-29
申请号:US17853236
申请日:2022-06-29
Applicant: Amazon Technologies, Inc.
Inventor: Chris Broaddus , Jayakrishnan Kumar Eledath , Tian Lan , Hui Liang , Gerard Guy Medioni , Chuhang Zou
CPC classification number: G06V20/44 , G06Q30/0643 , G06T7/70 , G06V10/7715 , G06V10/82 , G06V20/41 , G06V20/46 , G06V40/11 , H04N7/181 , G06T2207/10016 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084 , G06T2207/20132 , G06T2207/30196 , G06T2207/30242
Abstract: Cameras having storage fixtures within their fields of view are programmed to capture images and process clips of the images to generate sets of features representing product spaces and actors depicted within such images, and to classify the clips as depicting or not depicting a shopping event. Where consecutive clips are determined to depict a shopping event, features of such clips are combined into a sequence and transferred, along with classifications of the clips and a start time and end time of the shopping event, to a multi-camera system. A shopping hypothesis is generated based on such sequences of features received from cameras, along with information regarding items detected within the hands of such actors, to determine a summary of shopping activity by an actor, and to update a record of items associated with the actor accordingly.
-
公开(公告)号:US10915783B1
公开(公告)日:2021-02-09
申请号:US16220461
申请日:2018-12-14
Applicant: Amazon Technologies, Inc.
Inventor: Samuel Nathan Hallman , Petko Tsonev , Michael Francis O'Malley , Jayakrishnan Eledath , Jue Wang , Tian Lan
Abstract: An imaging device may capture images of a scene, where the scene includes retroreflective materials. Where visual images and depth images are captured from a scene, and the depth images have ratios of supersaturated pixels that are less than a predetermined threshold, a location map of the scene is generated or updated based on the depth images. Where the ratios are greater than the predetermined threshold, the location map of the scene is generated or updated based on the visual images. Additionally, where each of a plurality of imaging devices detect concentrations of supersaturated pixels beyond a predetermined threshold or limit within their respective fields of view, an actor present on the scene may be determined to be wearing retroreflective material, or otherwise designated as a source of the supersaturation, and tracked with the scene based on coverage areas that are determined to have excessive ratios of supersaturated pixels.
-
公开(公告)号:US11907339B1
公开(公告)日:2024-02-20
申请号:US17811450
申请日:2022-07-08
Applicant: Amazon Technologies, Inc.
Inventor: Behjat Siddiquie , Tian Lan , Jayakrishnan Eledath , Hoi Cheung Pang
IPC: G06F18/2411 , G06V40/10 , G06N20/00 , G06F18/214 , G06F18/2413
CPC classification number: G06F18/2411 , G06F18/214 , G06F18/24147 , G06N20/00 , G06V40/103
Abstract: As agents move about a materials handling facility, tracklets representative of the position of each agent are maintained along with a confidence score indicating a confidence that the position of the agent is known. If the confidence score falls below a threshold level, image data of the agent associated with the low confidence score is obtained and processed to generate one or more embedding vectors representative of the agent at a current position. Those embedding vectors are then compared with embedding vectors of other candidate agents to determine a set of embedding vectors having a highest similarity. The candidate agent represented by the set of embedding vectors having the highest similarity score is determined to be the agent and the position of that candidate agent is updated to the current position, thereby re-identifying the agent.
-
-
-
-
-