Abstract:
System and method are disclosed for training a generative adversarial network pipeline that can produce realistic artificial depth images useful as training data for deep learning networks used for robotic tasks. A generator network receives a random noise vector and a computer aided design (CAD) generated depth image and generates an artificial depth image. A discriminator network receives either the artificial depth image or a real depth image in alternation, and outputs a predicted label indicating a discriminator decision as to whether the input is the real depth image or the artificial depth image. Training of the generator network is performed in tandem with the discriminator network as a generative adversarial network. A generator network cost function minimizes correctly predicted labels, and a discriminator cost function maximizes correctly predicted labels.
Abstract:
A system includes a robot device that comprises a non-transitory computer readable medium and a robot controller. The non-transitory computer readable medium stores one or more machine-specific modules comprising base neural network layers. The robot controller receives a task-specific module comprising information corresponding to one or more task specific neural network layers enabling performance of a task. The robot controller collects one or more values from an operating environment, and uses the values as input to a neural network comprising the base neural network layers and the task-specific neural network layers to generate an output value. The robot controller may then perform the task based on the output value.
Abstract:
According to an aspect of the present disclosure, a computer-implemented includes creating a plurality of basic skill functions for a controllable physical device of an autonomous system. Each basic skill function includes a functional description for using the controllable physical device to interact with a physical environment to perform a defined objective. The method further includes selecting one or more basic skill functions to configure the controllable physical device to perform a defined task. The method also includes determining a decorator skill function specifying at least one constraint. The decorator skill function is configured to impose, at run-time, the at least one constraint, on the one or more basic skill functions. The method further includes generating executable code by applying the decorator skill function to the one or more basic skill functions, and actuating the controllable physical device using the executable code.
Abstract:
A system and method are disclosed for orchestrating the execution of computing tasks. An orchestration engine can receive task requests over a network from a plurality of process engines. The process engines may correspond to respective edge or field devices that are remotely located as compared to the orchestration engine. Each task request may indicate at least one task requirement for executing a respective computing task. A plurality of computing instances that have available computing resources can be selected from a set of computing instances. A predicted runtime can be generated for each of the computing tasks. In an example, based on the predicted runtimes, task requirements, available computing resources, and associated network conditions, a schedule and allocation scheme are determined by the orchestration engine. The schedule and allocation scheme define when each of the plurality of computing tasks is performed, and which of the plurality of selected computing instances performs each of the plurality of computing tasks. The selected computing instances execute the plurality of computing tasks according to the schedule and allocation scheme.
Abstract:
Systems and methods provide real-time production scheduling by integrating deep reinforcement learning and Monte Carlo tree search. A manufacturing process simulator is used to train a deep reinforcement learning agent to identify the sub-optimal policies for a production schedule. A Monte Carlo tree search agent is implemented to speed up the search for near-optimal policies of higher quality from the sub-optimal policies.
Abstract:
A method of generating events based on automation system data in an intelligent programmable logic controller includes the intelligent programmable logic controller collecting automation system data and applying a context model to the automation system data to create contextualized data. The intelligent programmable logic controller generates one or more events based on the contextualized data.
Abstract:
An edge device can be configured to perform industrial control operations within a production environment that defines a physical location. The edge device can include a plurality of neural network layers that define a deep neural network. The edge device be configured to obtain data from one or more sensors at the physical location defined by the production environment. The edge device can be further configured to perform one or more matrix operations on the data using the plurality of neural network layers so as to generate a large scale matrix computation at the physical location defined by the production environment. In some examples, the edge device can send the large scale matrix computation to a digital twin simulation model associated with the production environment, so as to update the digital twin simulation model in real time.
Abstract:
A computer-implemented method for failure classification of a surface treatment process includes receiving one or more process parameters that influence one or more failure modes of the surface treatment process and receiving sensor data pertaining to measurement of one or more process states pertaining to the surface treatment process. The method includes processing the received one or more process parameters and the sensor data by a machine learning model deployed on an edge computing device controlling the surface treatment process to generate an output indicating, in real-time, a probability of process failure via the one or more failure modes. The machine learning model is trained on a supervised learning regime based on process data and failure classification labels obtained from physics simulations of the surface treatment process in combination with historical data pertaining to the surface treatment process.
Abstract:
Over the past several decades, rapid advances in semiconductors, automation, and control systems have resulted in the adoption of programmable logic controllers (PLCs) in an immense variety of environments. Machine learning techniques help train replacement PLCs when a legacy PLC must be replaced, e.g., due to aging or failure. The techniques facilitate the efficient adoption and correct operation of replacement PLCs in the industrial environment.
Abstract:
In some cases, grasp point algorithms can be implemented so as to compute grasp points on an object that enable a stable grasp. It is recognized herein, however, that in practice a robot in motion can drop the object or otherwise have grasp issues when the object is grasped at the computed stable grasp points. Path constraints that can differ based on a given object are generated while generating the trajectory for a robot, so as to ensure that a grasp remains stable throughout the motion of the robot.