-
公开(公告)号:US11288415B2
公开(公告)日:2022-03-29
申请号:US16201872
申请日:2018-11-27
Applicant: Amazon Technologies, Inc.
Inventor: Sunil Mallya Kasaragod , Sahika Gene , Leo Parker Dirac , Bharathan Balaji , Eric Li Sun , Marthinus Coenraad De Clercq Wentzel , Brian James Townsend , Pramod Ravikumar Kumar
Abstract: A simulation workflow manager obtains a set of parameters for simulation of a system and training of a reinforcement learning model for optimizing an application of the system. In response to obtaining the set of parameters, the simulation workflow manager configures a first compute node that includes a training application for training the reinforcement learning model. The simulation workflow manager also configures a second compute note with a simulation application to perform the simulation of the system in a simulation environment. Data is generated through execution of the simulation in the second compute node that is provided to the first compute node to cause the training application to use the data to train the reinforcement learning model.
-
公开(公告)号:US20200167687A1
公开(公告)日:2020-05-28
申请号:US16201864
申请日:2018-11-27
Applicant: Amazon Technologies, Inc.
Inventor: Sahika Genc , Sunil Mallya Kasaragod , Leo Parker Dirac , Bharathan Balaji , Saurabh Gupta
Abstract: A simulation application container executes a simulation of a system in a simulation environment, through which an agent representing the system uses a reinforcement learning model to operate within the simulation environment. The simulation application container obtains data indicating how the agent performed in the simulation environment and transmits this data to a robot application container. The robot application container uses the data to update the reinforcement learning model and provides the updated reinforcement learning model to perform another iteration of the simulation and continue training the reinforcement learning model.
-
公开(公告)号:US12118456B1
公开(公告)日:2024-10-15
申请号:US16198730
申请日:2018-11-21
Applicant: Amazon Technologies, Inc.
Inventor: Sahika Genc , Bharathan Balaji , Urvashi Chowdhary , Leo Parker Dirac , Saurabh Gupta , Vineet Khare , Sunil Mallya Kasaragod
Abstract: A machine learning environment utilizing training data generated by customer networks. A reinforcement learning machine learning environment receives and processes training data generated by simulated hosted, or integrated, customer networks. The reinforcement learning machine learning environment corresponds to machine learning clusters that receive and process training data sets provided by the integrated customer networks. The customer networks include an agent process that collects training data and forwards the training data to the machine learning clusters. The machine learning clusters can be configured in a manner to automatically process the training data without requiring additional user inputs or controls to configure the application of the reinforcement learning machine learning processes.
-
公开(公告)号:US11861490B1
公开(公告)日:2024-01-02
申请号:US16198726
申请日:2018-11-21
Applicant: Amazon Technologies, Inc.
Inventor: Saurabh Gupta , Bharathan Balaji , Leo Parker Dirac , Sahika Genc , Vineet Khare , Ragav Venkatesan , Gurumurthy Swaminathan
IPC: G06N3/08 , G06N3/04 , G06F18/214 , G06F18/21
CPC classification number: G06N3/08 , G06F18/214 , G06F18/2178 , G06N3/04
Abstract: A machine learning environment utilizing training data generated by customer environments. A reinforced learning machine learning environment receives and processes training data generated by independently hosted, or decoupled, customer environments. The reinforced learning machine learning environment corresponds to machine learning clusters that receive and process training data sets provided by the decoupled customer environments. The customer environments include an agent process that collects training data and forwards the training data to the machine learning clusters without exposing the customer environment. The machine learning clusters can be configured in a manner to automatically process the training data without requiring additional user inputs or controls to configured the application of the reinforced learning machine learning processes.
-
公开(公告)号:US11836577B2
公开(公告)日:2023-12-05
申请号:US16201830
申请日:2018-11-27
Applicant: Amazon Technologies, Inc.
Inventor: Sunil Mallya Kasaragod , Sahika Genc , Leo Parker Dirac , Bharathan Balaji , Eric Li Sun , Marthinus Coenraad De Clercq Wentzel
CPC classification number: G06N20/00 , B25J9/163 , B25J9/1605 , B25J9/1671 , G06F7/023 , G06F30/20 , G06F30/27 , G06N5/022
Abstract: A simulation management service receives a request to perform reinforcement learning for a robotic device. The request can include computer-executable code defining a reinforcement function for training a reinforcement learning model for the robotic device. In response to the request, the simulation management service generates a simulation environment and injects the computer-executable code into a simulation application for the robotic device. Using the simulation application and the computer-executable code, the simulation management service performs the reinforcement learning within the simulation environment.
-
公开(公告)号:US11429762B2
公开(公告)日:2022-08-30
申请号:US16201872
申请日:2018-11-27
Applicant: Amazon Technologies, Inc.
Inventor: Sunil Mallya Kasaragod , Sahika Gene , Leo Parker Dirac , Bharathan Balaji , Eric Li Sun , Marthinus Coenraad De Clercq Wentzel , Brian James Townsend , Pramod Ravikumar Kumar
Abstract: A simulation workflow manager obtains a set of parameters for simulation of a system and training of a reinforcement learning model for optimizing an application of the system. In response to obtaining the set of parameters, the simulation workflow manager configures a first compute node that includes a training application for training the reinforcement learning model. The simulation workflow manager also configures a second compute note with a simulation application to perform the simulation of the system in a simulation environment. Data is generated through execution of the simulation in the second compute node that is provided to the first compute node to cause the training application to use the data to train the reinforcement learning model.
-
公开(公告)号:US11605021B1
公开(公告)日:2023-03-14
申请号:US16588245
申请日:2019-09-30
Applicant: Amazon Technologies, Inc.
Inventor: Vineet Khare , Saurabh Gupta , Yijie Zhuang , Bharathan Balaji , Runfei Luo , Siddhartha Agarwal
Abstract: Techniques for iterative model training and deployment for automated learning systems are described. A method of iterative model training and deployment for automated learning systems comprises generating training data based on inference data, provided by a first version of a model hosted at an endpoint of a machine learning service, and feedback data, received from a client application, using an identifier associated with the inference data and the feedback data, generating a second version of the model using the training data, and deploying the model to the endpoint of the machine learning service.
-
公开(公告)号:US20200167686A1
公开(公告)日:2020-05-28
申请号:US16201830
申请日:2018-11-27
Applicant: Amazon Technologies, Inc.
Inventor: Sunil Mallya Kasaragod , Sahika Genc , Leo Parker Dirac , Bharathan Balaji , Eric Li Sun , Marthinus Coenraad De Clercq Wentzel
Abstract: A simulation management service receives a request to perform reinforcement learning for a robotic device. The request can include computer-executable code defining a reinforcement function for training a reinforcement learning model for the robotic device. In response to the request, the simulation management service generates a simulation environment and injects the computer-executable code into a simulation application for the robotic device. Using the simulation application and the computer-executable code, the simulation management service performs the reinforcement learning within the simulation environment.
-
公开(公告)号:US20200167437A1
公开(公告)日:2020-05-28
申请号:US16201872
申请日:2018-11-27
Applicant: Amazon Technologies, Inc.
Inventor: Sunil Mallya Kasaragod , Sahika Genc , Leo Parker Dirac , Bharathan Balaji , Eric Li Sun , Marthinus Coenraad De Clercq Wentzel , Brian James Townsend , Pramod Ravikumar Kumar
Abstract: A simulation workflow manager obtains a set of parameters for simulation of a system and training of a reinforcement learning model for optimizing an application of the system. In response to obtaining the set of parameters, the simulation workflow manager configures a first compute node that includes a training application for training the reinforcement learning model. The simulation workflow manager also configures a second compute note with a simulation application to perform the simulation of the system in a simulation environment. Data is generated through execution of the simulation in the second compute node that is provided to the first compute node to cause the training application to use the data to train the reinforcement learning model.
-
-
-
-
-
-
-
-