-
公开(公告)号:US12131288B1
公开(公告)日:2024-10-29
申请号:US17457590
申请日:2021-12-03
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: Paul Eugene Munger , Jayakrishnan Kumar Eledath , Daniel Bibireata , Gopi Prashanth Gopal , Liefeng Bo
IPC: G06Q10/087 , G06Q20/20
CPC classification number: G06Q10/087 , G06Q20/208
Abstract: Tidiness data associated with an inventory location, such as a shelf, indicates whether an item returned to the inventory location is designated for storage at the inventory location. When an item is returned to the inventory location and a user is determined to be near the inventory location, the weight change detected at the inventory location is compared to a corresponding weight of each item in the custody of the user, such as items within cart state data associated with the user. Differences in weight between the weight change and the corresponding weight of each item in the custody of the user are calculated. Such differences may then be compared to one or more metrics, such as threshold values, to determine how well the top candidate item in the custody of the user matches the type of item designated for storage at the inventory location.
-
公开(公告)号:US11869065B1
公开(公告)日:2024-01-09
申请号:US16272420
申请日:2019-02-11
Applicant: Amazon Technologies, Inc.
Inventor: Jayakrishnan Kumar Eledath , Nikhil Chacko , Alessandro Bergamo , Kaustav Kundu , Marian Nasr Amin George , Jingjing Liu , Nishitkumar Ashokkumar Desai , Pahal Kamlesh Dalal , Keshav Nand Tripathi
IPC: G06Q30/0601 , G06V10/40 , G06V40/20 , G06F18/241
CPC classification number: G06Q30/0633 , G06F18/241 , G06V10/40 , G06V40/28
Abstract: This disclosure describes systems and techniques for identifying events that occur within an environment using image data captured at the environment. For example, one or more cameras may generate image data representative of a user interacting with an item on the shelf. This image data may be used to generate feature data associated with the user and the item, which may be analyzed by one or more classifiers for identifying an interaction between the user and the item. The systems and techniques may then generate interaction data, which in turn may be analyzed by one or more additional classifiers for identifying an event, such as the user picking a particular item from the shelf within the environment. Event data indicative of the event may then be used to update a virtual cart of the user.
-
公开(公告)号:US11301984B1
公开(公告)日:2022-04-12
申请号:US16022439
申请日:2018-06-28
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: Dilip Kumar , Nikhil Chacko , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Gopi Prashanth Gopal , Gerard Guy Medioni , Kushagra Srivastava
Abstract: Sensors in a facility obtain sensor data about a user's interaction with a fixture, such as a shelf. The sensor data may include images such as obtained from overhead cameras, weight changes from weight sensors at the shelf, and so forth. Based on the sensor data, one or more hypotheses that indicate the items and quantity may be determined and assessed. The hypotheses may be based on information such as the location of a user and where their hands are, weight changes, physical layout data indicative of where items are stowed, cart data indicative of what items are in the possession of the user, and so forth. A hypothesis having a greatest confidence value may be deemed to be representative of the user's interaction, and interaction data indicative of the item and quantity may be stored.
-
公开(公告)号:US12131539B1
公开(公告)日:2024-10-29
申请号:US17853236
申请日:2022-06-29
Applicant: Amazon Technologies, Inc.
Inventor: Chris Broaddus , Jayakrishnan Kumar Eledath , Tian Lan , Hui Liang , Gerard Guy Medioni , Chuhang Zou
CPC classification number: G06V20/44 , G06Q30/0643 , G06T7/70 , G06V10/7715 , G06V10/82 , G06V20/41 , G06V20/46 , G06V40/11 , H04N7/181 , G06T2207/10016 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084 , G06T2207/20132 , G06T2207/30196 , G06T2207/30242
Abstract: Cameras having storage fixtures within their fields of view are programmed to capture images and process clips of the images to generate sets of features representing product spaces and actors depicted within such images, and to classify the clips as depicting or not depicting a shopping event. Where consecutive clips are determined to depict a shopping event, features of such clips are combined into a sequence and transferred, along with classifications of the clips and a start time and end time of the shopping event, to a multi-camera system. A shopping hypothesis is generated based on such sequences of features received from cameras, along with information regarding items detected within the hands of such actors, to determine a summary of shopping activity by an actor, and to update a record of items associated with the actor accordingly.
-
公开(公告)号:US11810362B1
公开(公告)日:2023-11-07
申请号:US16808014
申请日:2020-03-03
Applicant: Amazon Technologies, Inc.
Inventor: Behjat Siddiquie , Jayakrishnan Kumar Eledath , Petko Tsonev , Nishitkumar Ashokkumar Desai , Gerard Guy Medioni , Jean Laurent Guigues , Chuhang Zou , Connor Spencer Blue Worley , Claire Law , Paul Ignatius Dizon Echevarria , Matthew Fletcher Harrison , Pahal Kamlesh Dalal
IPC: G06F16/587 , G06K9/00 , G06V20/52 , G06V10/22 , G06V40/20
CPC classification number: G06V20/52 , G06F16/587 , G06V10/235 , G06V40/20
Abstract: This disclosure describes techniques for updating planogram data associated with a facility. The planogram may indicate inventory locations within the facility for various types of items supported by product fixtures. In particular an image of a product fixture is analyzed to identify image segments corresponding to product groups, where each product group consists of instances of the same product and each image segment corresponds to a group of image points. Image data is further analyzed to determine coordinates of the points of each image segment. A product space corresponding to the product group is then defined based on the coordinates of the points of the product group. In some cases, for example, a product space may be defined in terms of the coordinates of the corners of a rectangular bounding box or volume.
-
公开(公告)号:US11482045B1
公开(公告)日:2022-10-25
申请号:US16799502
申请日:2020-02-24
Applicant: Amazon Technologies, Inc.
Inventor: Jaechul Kim , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Kartik Muktinutalapati , Shaonan Zhang , Hoi Cheung Pang , Dilip Kumar , Kushagra Srivastava , Gerard Guy Medioni , Daniel Bibireata
IPC: G06K9/00 , G06V40/20 , G06K9/62 , G06F17/16 , G06Q30/02 , G06N3/08 , G06N20/00 , G06V20/10 , G06V20/52
Abstract: Where an event is determined to have occurred at a location within a vicinity of a plurality of actors, imaging data captured using cameras having the location is processed using one or more machine learning systems or techniques operating on the cameras to determine which of the actors is most likely associated with the event. For each relevant pixel of each image captured by a camera, the camera returns a set of vectors extending to pixels of body parts of actors who are most likely to have been involved with an event occurring at the relevant pixel, along with a measure of confidence in the respective vectors. A server receives the vectors from the cameras, determines which of the images depicted the event in a favorable view, based at least in part on the quality of such images, and selects one of the actors as associated with the event accordingly.
-
公开(公告)号:US11195140B1
公开(公告)日:2021-12-07
申请号:US15703302
申请日:2017-09-13
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: Paul Eugene Munger , Jayakrishnan Kumar Eledath , Daniel Bibireata , Gopi Prashanth Gopal , Liefeng Bo
Abstract: A user may pick an item from a first inventory location, such as in a lane on a shelf, and may return it another location that is assigned to another type of item. Described are techniques to generate tidiness data that is indicative of whether an item has been returned to an inventory location assigned to that type of item. As items are taken, information about the type of item taken and its weight are stored. When an increase in weight at a lane indicates a return of an item to the lane, the weight of the return is compared to the stored weight of the items previously taken by a user. If the weights correspond to within a threshold value, the type of item associated with the stored weight is deemed to be returned and tidiness data indicative of a tidy return of the item to its appointed lane may be generated.
-
公开(公告)号:US12198179B1
公开(公告)日:2025-01-14
申请号:US18242197
申请日:2023-09-05
Applicant: Amazon Technologies, Inc.
Inventor: Behjat Siddiquie , Petko Tsonev , Claire Law , Connor Spencer Blue Worley , Jue Wang , Bharat Singh , Hue Tuan Thi , Jayakrishnan Kumar Eledath , Nishitkumar Ashokkumar Desai
IPC: G06V10/40 , G06Q10/087 , G06Q30/0601 , G06V20/40 , G06V20/52
Abstract: This disclosure describes techniques for updating planogram data associated with a facility. The planogram may indicate, for different shelves and other inventory locations within the facility, which items are on which shelves. For example, the planogram data may indicate that a particular item is located on a particular shelf. Therefore, when a system identifies that a user has taken an item from that shelf, the system may update a virtual cart of that user to indicate addition of the particular item. In some instances, however, a new item may be stocked on the example shelf instead of a previous item. The techniques described herein may use sensor data generated in the facility to identify this change and update the planogram data to indicate an association between the shelf and the new item.
-
公开(公告)号:US12165480B1
公开(公告)日:2024-12-10
申请号:US17867047
申请日:2022-07-18
Applicant: Amazon Technologies, Inc.
Inventor: Shane Michael Wilson , Matthew Norman , Jayakrishnan Kumar Eledath
Abstract: This disclosure describes, in part, systems for enabling physical retail stores and other facilities to implement both automated- and manual-checkout techniques for customers of the stores and/or facilities. For example, the described systems may enable a retail store to implement technology where users are able to pick items from shelves and other inventory locations and exit the store without performing manual checkout of the items, as well as technology to allow users to pay for their items using point-of-sale (POS) and/or other manual-checkout techniques. The systems described herein thus enable hybrid retail facilities, as opposed to a retail facility that is either entirely traditional or entirely enabled for automated checkout.
-
公开(公告)号:US11625838B1
公开(公告)日:2023-04-11
申请号:US17218476
申请日:2021-03-31
Applicant: Amazon Technologies, Inc.
Inventor: Dinesh Reddy Narapureddy , Jean Laurent Guigues , Leonid Pishchulin , Jayakrishnan Kumar Eledath
Abstract: Devices and techniques are generally described for articulated three-dimensional pose tracking. In some examples, a plurality of frames of image data captured by one or more cameras may be received. First feature data representing the plurality of frames of image data may be determined using a backbone network. The first feature data may be projected into three-dimensional (3D) space. In some examples, 3D location data describing respective 3D locations of one or more persons represented by the first feature data projected in the 3D space may be determined. The first feature data and the 3D location data may be sent to a four-dimensional (4D) convolutional neural network (CNN). The 4D CNN may generate second feature data comprising respective 3D representations of the one or more persons. Three dimensional pose data representing articulated 3D pose information for the one or more persons may be generated.
-
-
-
-
-
-
-
-
-