公开(公告)号：US20240140724A1

公开(公告)日：2024-05-02

申请号：US18548293

申请日：2022-02-01

申请人： Körber Supply Chain Logistics GmbH

发明人： Michael Zettler ,  Marc Christian Weber ,  Daniel Hein ,  Clemens Otte ,  Martin Schall ,  Frank Pfeiffer

IPC分类号： B65G43/08 ,  B65G43/10 ,  G05B19/418

CPC分类号： B65G43/08 ,  B65G43/10 ,  G05B19/4189

摘要： A computer-implemented method, a device for data processing and a computer system for controlling a control device of a conveyor system to achieve an alignment and/or a defined spacing of piece goods, wherein the control of the control device is determined by an agent acting according to Reinforcement Learning methods. An individual, local state vector of predefined dimension that is the same for all the piece goods is created for each of the piece goods and an action vector is selected from an action space according to a strategy that is the same for all piece goods for the current state vector of this piece good. These action vectors are projected onto the conveying elements, wherein conflicts are resolved. After a cycle time has elapsed, state vectors are created again for each piece good and evaluated with rewards and the strategy is adjusted.