Deep reinforcement learning for air handling and fuel system referencing

    公开(公告)号:US10746123B2

    公开(公告)日:2020-08-18

    申请号:US16106300

    申请日:2018-08-21

    Applicant: Cummins Inc.

    Abstract: An engine system includes an air handling and fuel system whose states are managed by a reference managing unit. The engine system has a plurality of sensors whose sensor signals at least partially define a current state of the engine system. The reference managing unit includes a controller which controls the air handling and fuel system of the engine system as well as a processing unit coupled to the sensors and the controller. The processing unit includes an agent which learns a policy function that is trained to process the current state, determines air handling references and fuel system references by using the policy function after receiving the current state as an input, and outputs the air handling references and fuel system references to the controller. Then, the agent receives a next state and a reward value from the processing unit and updates the policy function using a policy evaluation algorithm and a policy improvement algorithm based on the received reward value. Subsequently, the controller controls the air handling and fuel system of the engine in response to receiving the air handling references and the fuel system references.

    OPTIMIZED DIAGNOSTIC MODEL USING VEHICLE DATA

    公开(公告)号:US20240326838A1

    公开(公告)日:2024-10-03

    申请号:US18694927

    申请日:2022-09-30

    Applicant: CUMMINS INC.

    CPC classification number: B60W50/0205 B60W50/035

    Abstract: Systems, devices, and methods for optimizing troubleshooting procedures for vehicles are disclosed herein. A system includes a processor and a memory storing executable instructions. The executable instructions, when executed by the processor, cause the processor to: obtain in-operation data of a vehicle, the in-operation data including a fault code indicative of a fault in the vehicle; identify a trained model from a plurality of trained models using the fault code; use the trained model and the in-operation data of the vehicle to generate a troubleshooting procedure for identifying a root cause of the fault; and provide the troubleshooting procedure as output to identify the root cause of the fault.

    Deep reinforcement learning for air handling control

    公开(公告)号:US11002202B2

    公开(公告)日:2021-05-11

    申请号:US16106311

    申请日:2018-08-21

    Applicant: Cummins Inc.

    Abstract: An engine system includes an air handling control unit which controls a plurality of air handling actuators responsible for maintaining flow of air and exhaust gas within the engine system. The engine system has a plurality of sensors whose sensor signals at least partially define a current state of the engine system. The air handling control unit includes a controller which controls the air handling actuators of the engine system as well as a processing unit coupled to the sensors and the controller. The processing unit includes an agent which learns a policy function that is trained to process the current state, determines a control signal to send to the controller by using the policy function after receiving the current state as an input, and outputs the control signal to the controller. Then, the agent receives a next state and a reward value from the processing unit and updates the policy function using a policy evaluation algorithm and a policy improvement algorithm based on the received reward value. Subsequently, the controller controls the air handling actuators in response to receiving the control signal. In one aspect of the embodiment, the control signal is a command signal for the air handling actuators.

    DEEP REINFORCEMENT LEARNING FOR AIR HANDLING AND FUEL SYSTEM REFERENCING

    公开(公告)号:US20200063681A1

    公开(公告)日:2020-02-27

    申请号:US16106300

    申请日:2018-08-21

    Applicant: Cummins Inc.

    Abstract: An engine system includes an air handling and fuel system whose states are managed by a reference managing unit. The engine system has a plurality of sensors whose sensor signals at least partially define a current state of the engine system. The reference managing unit includes a controller which controls the air handling and fuel system of the engine system as well as a processing unit coupled to the sensors and the controller. The processing unit includes an agent which learns a policy function that is trained to process the current state, determines air handling references and fuel system references by using the policy function after receiving the current state as an input, and outputs the air handling references and fuel system references to the controller. Then, the agent receives a next state and a reward value from the processing unit and updates the policy function using a policy evaluation algorithm and a policy improvement algorithm based on the received reward value. Subsequently, the controller controls the air handling and fuel system of the engine in response to receiving the air handling references and the fuel system references.

    DEEP REINFORCEMENT LEARNING FOR AIR HANDLING CONTROL

    公开(公告)号:US20200063676A1

    公开(公告)日:2020-02-27

    申请号:US16106311

    申请日:2018-08-21

    Applicant: Cummins Inc.

    Abstract: An engine system includes an air handling control unit which controls a plurality of air handling actuators responsible for maintaining flow of air and exhaust gas within the engine system. The engine system has a plurality of sensors whose sensor signals at least partially define a current state of the engine system. The air handling control unit includes a controller which controls the air handling actuators of the engine system as well as a processing unit coupled to the sensors and the controller. The processing unit includes an agent which learns a policy function that is trained to process the current state, determines a control signal to send to the controller by using the policy function after receiving the current state as an input, and outputs the control signal to the controller. Then, the agent receives a next state and a reward value from the processing unit and updates the policy function using a policy evaluation algorithm and a policy improvement algorithm based on the received reward value. Subsequently, the controller controls the air handling actuators in response to receiving the control signal. In one aspect of the embodiment, the control signal is a command signal for the air handling actuators.

Patent Agency Ranking