公开(公告)号：US20220410391A1

公开(公告)日：2022-12-29

申请号：US17778909

申请日：2019-11-22

申请人： Siemens Aktiengesellschaft

发明人： Juan L. Aparicio Ojea ,  Heiko Claussen ,  Ines Ugalde Diaz ,  Martin Sehr ,  Eugen Solowjow ,  Chengtao Wen ,  Wei Xi Xia ,  Xiaowen Yu ,  Shashank Tamaskar

IPC分类号： B25J9/16

摘要： In current applications of autonomous machines in industrial settings, the environment, in particular the devices and systems with which the machine interacts, is known such that the autonomous machine can operate in the particular environment successfully. Thus, current approaches to automating tasks within varying environments, for instance complex environments having uncertainties, lack capabilities and efficiencies. In an example aspect, a method for operating an autonomous machine within a physical environment includes detecting an object within the physical environment. The autonomous machine can determine and perform a principle of operation associated with a detected subcomponent of the object, so as to complete a task that requires that the autonomous machine interacts with the object. In some cases, the autonomous machine has not previously encountered the object.

公开(公告)号：US20230050387A1

公开(公告)日：2023-02-16

申请号：US17794065

申请日：2020-02-11

申请人： Siemens Aktiengesellschaft

发明人： Juan L. Aparicio Ojea ,  Heiko Claussen ,  Ines Ugalde Diaz ,  Martin Sehr ,  Eugen Solowjow ,  Chengtao Wen ,  Wei Xi Xia ,  Xiaowen Yu ,  Shashank Tamaskar

IPC分类号： G05B19/418

摘要： According to an aspect of the present disclosure, a computer-implemented includes creating a plurality of basic skill functions for a controllable physical device of an autonomous system. Each basic skill function includes a functional description for using the controllable physical device to interact with a physical environment to perform a defined objective. The method further includes selecting one or more basic skill functions to configure the controllable physical device to perform a defined task. The method also includes determining a decorator skill function specifying at least one constraint. The decorator skill function is configured to impose, at run-time, the at least one constraint, on the one or more basic skill functions. The method further includes generating executable code by applying the decorator skill function to the one or more basic skill functions, and actuating the controllable physical device using the executable code.

公开(公告)号：US20210278825A1

公开(公告)日：2021-09-09

申请号：US17260252

申请日：2018-08-23

申请人： Siemens Aktiengesellschaft

发明人： Chengtao Wen ,  Wei Xi Xia ,  Juan L. Aparicio Ojea

IPC分类号： G05B19/418 ,  G06N3/08 ,  G06N7/00

摘要： Systems and methods provide real-time production scheduling by integrating deep reinforcement learning and Monte Carlo tree search. A manufacturing process simulator is used to train a deep reinforcement learning agent to identify the sub-optimal policies for a production schedule. A Monte Carlo tree search agent is implemented to speed up the search for near-optimal policies of higher quality from the sub-optimal policies.

公开(公告)号：US20220391565A1

公开(公告)日：2022-12-08

申请号：US17824300

申请日：2022-05-25

申请人： Siemens Aktiengesellschaft

发明人： Chengtao Wen ,  Juan L. Aparicio Ojea ,  Ines Ugalde Diaz ,  Gokul Narayanan Sathya Narayanan ,  Eugen Solowjow ,  Wei Xi Xia ,  Yash Shahapurkar ,  Shashank Tamaskar ,  Heiko Claussen

IPC分类号： G06F30/27

摘要： A method for automatically generating a bill of process in a manufacturing system comprising: receiving design information representative of a product to be produced; iteratively performing simulations of the manufacturing system; identifying manufacturing actions based on the simulations; optimizing the identified manufacturing actions to efficiently produce the product to be produced; generating, by the manufacturing system, a bill of process for producing the product. Simulations may be performed using a digital twin of the product being produced and a digital twin of the environment. System actions are optimized using a reinforcement learning technique to automatically produce a bill of process based on the design information of the product and task specifications.

公开(公告)号：US20220297295A1

公开(公告)日：2022-09-22

申请号：US17666836

申请日：2022-02-08

申请人： Siemens Aktiengesellschaft

发明人： Juan L. Aparicio Ojea ,  Heiko Claussen ,  Ines Ugalde Diaz ,  Yash Shahapurkar ,  Eugen Solowjow ,  Chengtao Wen ,  Wei Xi Xia ,  Gokul Narayanan Sathya Narayanan ,  Shashank Tamaskar

IPC分类号： B25J9/16 ,  G05B17/02

摘要： A computer-implemented method for designing execution of a process by a robotic cell includes obtaining a process goal and one or more process constraints. The method includes accessing a library of constructs and a library of skills. Each construct includes a digital representation of a component of the robotic cell or a geometric transformation of the robotic cell. Each skill includes a functional description for using a robot of the robotic cell to interact with a physical environment to perform a skill objective. The method uses a simulation engine to simulate a multiplicity of designs, wherein each design is characterized by a combination of constructs and skills to achieve the process goal, and determine a set of feasible designs that meet the one or more process constraints. The method includes outputting recommended designs from the set of feasible designs.