公开(公告)号：US20240273863A1

公开(公告)日：2024-08-15

申请号：US18168198

申请日：2023-02-13

申请人： Walmart Apollo, LLC

发明人： Ashlin Ghosh ,  Feiyun Zhu ,  Avinash M. Jade ,  Lingfeng Zhang ,  Amit Jhunjhunwala ,  Raghava Balusu ,  William Craig Robinson, JR. ,  Benjamin R. Ellison ,  Srinivas Muktevi ,  Zhaoliang Duan

IPC分类号： G06V10/762 ,  G06Q10/087 ,  G06V10/74

CPC分类号： G06V10/762 ,  G06Q10/087 ,  G06V10/761 ,  G06V2201/07

摘要： In some embodiments, apparatuses and methods are provided herein useful to processing captured images. In some embodiments, there is provided a system for processing captured images of objects at a product storage facility including a trained machine learning model; and a control circuit. The control circuit may group a plurality of product identifiers into one or more clusters based on at least one of visual similarity of corresponding images, textual similarity of corresponding associated descriptions, and associated relationships between product identifiers of the plurality of product identifiers; determine clusters having common elements that are at least within a similarity threshold of each other; merge the clusters with the common elements; and generate a mapping dataset used to retrain the trained machine learning model to identify a plurality of objects. The mapping dataset may include a plurality of associations of associated product identifiers to a single object.

公开(公告)号：US20240257380A1

公开(公告)日：2024-08-01

申请号：US18103338

申请日：2023-01-30

申请人： Walmart Apollo, LLC

发明人： Wei Wang ,  Lingfeng Zhang ,  Han Zhang ,  Avinash M. Jade ,  Mingquan Yuan ,  Zhaoliang Duan ,  Siddhartha Chakraborty ,  Benjamin R. Ellison ,  William Craig Robinson, JR. ,  Eric W. Rader

IPC分类号： G06T7/70 ,  B25J5/00 ,  G06T7/90 ,  G06V10/10 ,  G06V10/56

CPC分类号： G06T7/70 ,  B25J5/007 ,  G06T7/90 ,  G06V10/16 ,  G06V10/56 ,  G06T2207/10024 ,  G06V2201/07

摘要： Systems and methods of detecting support members of product storage structures that store products at a product storage facility include an image capture device that captures images of a product storage structure including vertical and horizontal support members. A computing device including a control circuit is configured to: obtain the images of the product storage structure captured by the image capture device, stitch the obtained images together to generate a stitched image that depicts the product storage structure, generate a color distribution map of the stitched image of the product storage structure to detect individual ones of the horizontal and vertical support members of the product storage structure.

公开(公告)号：US20240119735A1

公开(公告)日：2024-04-11

申请号：US17963787

申请日：2022-10-11

申请人： Walmart Apollo, LLC

发明人： Lingfeng Zhang ,  Mingquan Yuan ,  Paul Lewis Lobo ,  Avinash M. Jade ,  Zhichun Xiao ,  William Craig Robinson, JR. ,  Zhaoliang Duan ,  Wei Wang ,  Han Zhang ,  Raghava Balusu ,  Tianyi Mao

IPC分类号： G06V20/52 ,  G06Q10/08 ,  G06V20/00

CPC分类号： G06V20/52 ,  G06Q10/087 ,  G06V20/36

摘要： Systems and methods of monitoring inventory of a product storage facility include an image capture device configured to move about the product storage areas of the product storage facility and capture images of the product storage areas from various angles. A computing device coupled to the image capture device obtains the images of the product storage areas captured by the image capture device and processes the obtained images of the product storage areas to detect individual products captured in the obtained images. Based on detection of the individual products captured in the images, the computing device analyzes each of the obtained images to detect one or more adjacent product storage structures (shelves, pallets, etc.) and identifies and selects a single image that fully shows a product storage structure of interest and fully shows each of the products stored on the product storage structure of interest.

公开(公告)号：US20240249239A1

公开(公告)日：2024-07-25

申请号：US18158983

申请日：2023-01-24

申请人： Walmart Apollo, LLC

发明人： Ashlin Ghosh ,  Raghava Balusu ,  Abhinav Pachauri ,  Avinash M. Jade ,  Lingfeng Zhang ,  Amit Jhunjhunwala ,  William Craig Robinson, JR. ,  Benjamin R. Ellison ,  Srinivas Muktevi ,  Zhaoliang Duan

IPC分类号： G06Q10/087

CPC分类号： G06Q10/087

摘要： Systems and methods of creating reference template images for detecting and recognizing products at a product storage facility include an image capture device having a field of view that includes a product storage structure of the product storage facility, and a computing device including a control circuit and being communicatively coupled to the image capture device. The computing device obtains images of the product storage structure captured by the image capture device, analyzes the obtained images to detect individual ones of the products located on the product storage structure. Then, the computing device identifies the individual ones of the products detected in the images and crops each of the individual ones of the identified products from the images to generate cropped images. The computing device then creates a cluster of the cropped images, and selects one of the cropped images as a reference template image of an identified individual product.

公开(公告)号：US20230343326A1

公开(公告)日：2023-10-26

申请号：US17730027

申请日：2022-04-26

申请人： Walmart Apollo, LLC

发明人： Praneeth Gubbala ,  Xuan Zhang ,  Bahula Bosetti ,  Priya Ashok Kumar Choudhary ,  Dong T. Nguyen ,  Shivraj V. Kodak ,  William Craig Robinson, JR.

IPC分类号： G10L15/06 ,  G06F16/683 ,  G10L15/02

CPC分类号： G10L15/063 ,  G06F16/685 ,  G10L15/02 ,  G10L2015/086

摘要： Some embodiments provide retail product ordering systems comprising: a user computing device comprising an application executed by a device control circuit to: receive an audible utterance; controls a product identifier application interface to: apply a tokenizer model and obtain a set of individual search words; apply a series of featurizer models to the search words to generate features; and apply a classifier and extractor model based on the features and generate multiple requested product entities each comprising a respective sub-set of the position labeled product terms; wherein the device control circuit is further configured to access a purchase history database, confirm an accuracy of each of requested product entities relative to a purchase history, generate a listing of determined product identifiers corresponding to the confirmed set of the multiple requested product entities, and control a display system of the user computing device to render the listing of determined product identifiers.

公开(公告)号：US20240265565A1

公开(公告)日：2024-08-08

申请号：US18165152

申请日：2023-02-06

申请人： Walmart Apollo, LLC

发明人： Han Zhang ,  Yilun Chen ,  Lingfeng Zhang ,  Adam Cantor ,  Avinash M. Jade ,  Benjamin R. Ellison ,  William Craig Robinson, JR. ,  Mingquan Yuan ,  Zhaoliang Duan ,  Wei Wang

IPC分类号： G06T7/70 ,  G06T7/50 ,  G06V10/25 ,  G06V10/762

CPC分类号： G06T7/70 ,  G06T7/50 ,  G06V10/25 ,  G06V10/762 ,  G06V2201/07

摘要： In some embodiments, apparatuses and methods are provided herein useful to processing captured images. In some embodiments, there is provided a system for processing captured images of objects at a product storage facility including a trained machine learning model stored in a memory; and a control circuit. The control circuit may obtain an image at the product storage facility; cluster objects depicted in the image that have same product identifiers into a corresponding group; determine coordinates of each bounding box of each clustered object in the corresponding group; determine a bounding box representative depth value of pixels inside the bounding box of each clustered object; determine an overall representative depth value of the corresponding group based on bounding box representative depth values of clustered objects; and exclude the clustered objects from identified objects in the image upon a determination that the overall representative depth value is greater than a threshold.

公开(公告)号：US20200349200A1

公开(公告)日：2020-11-05

申请号：US16862939

申请日：2020-04-30

申请人： Walmart Apollo, LLC

发明人： William Craig Robinson, JR. ,  Dong T. Nguyen ,  Mekhala M. Vithala ,  Makeshwaran Sampath ,  Spencer S. Seeger ,  Bahula Bosetti ,  Praneeth Gubbala ,  Songshan Li ,  Santosh Kumar Kurashetty ,  Srihari Attuluri ,  Venkata Maguluri ,  Lindsay S. Leftwich ,  George E. Loring

IPC分类号： G06F16/9032 ,  G06Q30/06 ,  G10L15/26

摘要： In some embodiments, methods and systems are provided for processing information requests of workers at a retail facility and retrieving information associated with the retail facility based on the information requests. An electronic device permits a worker at the retail facility to input an information request in association with at least one worker at the retail facility or at least one product at the retail facility. A computing device receives, from the electronic device, electronic data representative of a scope of the information request, analyzes this electronic data to determine the scope of the information request, obtain relevant information from one or more databases, and transmits the obtained information to the electronic device, which in turn outputs the information to the worker.