Reinforcement learning control of vehicle systems

    公开(公告)号:US12195020B2

    公开(公告)日:2025-01-14

    申请号:US16906674

    申请日:2020-06-19

    Applicant: Cummins Inc.

    Abstract: A system includes a sensor array and a processing circuit. The processing circuit is operable to: store a policy; receive the sensor information from the sensor array; receive horizon information from a horizon system; input the sensor information and the horizon information into the policy; determine an output of the policy based on the input of the sensor information and the horizon information; control operation of a vehicle system according to the output; compare the sensor information received after controlling operation of the vehicle system according to the output relative to a reward or penalty condition; provide one of a reward signal or a penalty signal in response to the comparison; update the policy based on receipt of the reward signal or the penalty signal; and control the vehicle system using the updated policy to improve operation in view of the operating parameter.

    SYSTEMS AND METHODS FOR PREDICTIVE LANE CHANGE

    公开(公告)号:US20240386759A1

    公开(公告)日:2024-11-21

    申请号:US18787860

    申请日:2024-07-29

    Applicant: Cummins Inc.

    Inventor: Hoseinali Borhan

    Abstract: A method includes: receiving information indicative of operation of a vehicle and of a driving condition for the vehicle; determining a slowdown event of the vehicle within a predefined time period or distance based on the received information; determining, in response to the determination of the slowdown event within the predefined time period or distance; that a takeover event is feasible based on the received information; and, initiating the takeover event in response to the determination that the takeover event is feasible.

    SYSTEM AND METHOD FOR PREDICTIVE ENGINE AND AFTERTREATMENT SYSTEM CONTROL

    公开(公告)号:US20190168753A1

    公开(公告)日:2019-06-06

    申请号:US15833775

    申请日:2017-12-06

    Applicant: Cummins, Inc.

    Abstract: Systems and apparatuses include a controller structured to: receive information indicative of an operating condition of a vehicle subsystem, receive information indicative of an external static condition, and receive information indicative of an external dynamic condition. The system is further configured to predict a fuel cut event based on at least one of the operating condition of the vehicle subsystem, the external static condition, and the external dynamic condition. Responsive to predicting a fuel cut event, the controller is structured to modulate at least one of a torque or a speed of the engine based on the operating condition of the vehicle subsystem and at least one of the information indicative of the external static condition and the external dynamic condition.

    APPARATUSES, METHODS, AND SYSTEMS OF CONTROLLING VEHICLE PLATOONS

    公开(公告)号:US20230386343A1

    公开(公告)日:2023-11-30

    申请号:US18323813

    申请日:2023-05-25

    Applicant: Cummins Inc.

    CPC classification number: G08G1/22 B60W30/165 B60W2756/10

    Abstract: A method of operating a platoon of vehicles may include determining a joint optimization of operating parameters of a forward vehicle of the platoon and a rearward vehicle of the platoon. The operating parameters of the forward vehicle may include vehicle motion plan parameters for the forward vehicle. The operating parameters of the rearward vehicle may include suggested control actions for the second vehicle. The method may include wirelessly transmitting from the forward vehicle the vehicle motion plan parameters for the forward vehicle and the suggested control actions for the rearward vehicle, wirelessly receiving at the forward vehicle following vehicle capability parameters indicating capability of the following vehicle, determining in response to the following vehicle capability parameters an updated joint optimization including updated vehicle motion plan parameters for the forward vehicle, and controlling motion of the forward vehicle in response to the updated vehicle motion plan parameters.

    SYSTEMS AND METHODS FOR PREDICTIVE LANE CHANGE

    公开(公告)号:US20230050759A1

    公开(公告)日:2023-02-16

    申请号:US17403189

    申请日:2021-08-16

    Applicant: Cummins Inc.

    Inventor: Hoseinali Borhan

    Abstract: A system includes a controller comprising at least one processor coupled to a memory storing instructions that, when executed by the at least one processor, cause the at least one processor to perform operations comprising: receiving information indicative of operation of the vehicle and of a driving condition for the vehicle; determining that a speed of the vehicle is less than a target speed for the vehicle based on the received information; determining, in response to the determination that the speed is less than the target speed, that the lane change and takeover event is at least one of feasible or efficient based on the received information; and providing, in response to the determination regarding the lane change and takeover event, a notification.

    System and method for predictive engine and aftertreatment system control

    公开(公告)号:US10576978B2

    公开(公告)日:2020-03-03

    申请号:US15833775

    申请日:2017-12-06

    Applicant: Cummins, Inc.

    Abstract: Systems and apparatuses include a controller structured to: receive information indicative of an operating condition of a vehicle subsystem, receive information indicative of an external static condition, and receive information indicative of an external dynamic condition. The system is further configured to predict a fuel cut event based on at least one of the operating condition of the vehicle subsystem, the external static condition, and the external dynamic condition. Responsive to predicting a fuel cut event, the controller is structured to modulate at least one of a torque or a speed of the engine based on the operating condition of the vehicle subsystem and at least one of the information indicative of the external static condition and the external dynamic condition.

    OPTIMIZATION-BASED CONTROLS FOR DIESEL ENGINE AIR-HANDLING SYSTEMS
    9.
    发明申请
    OPTIMIZATION-BASED CONTROLS FOR DIESEL ENGINE AIR-HANDLING SYSTEMS 有权
    柴油发动机空调系统优化控制

    公开(公告)号:US20160025020A1

    公开(公告)日:2016-01-28

    申请号:US14338970

    申请日:2014-07-23

    Applicant: Cummins Inc.

    Abstract: System, apparatus, and methods are disclosed for a computing a first set of parameters based on operational states of an internal combustion engine and an air handling system, a second set of parameters based on a linear time varying model, and one or more control commands based upon a minimization or maximization of a cost function over a prediction horizon, the second set of parameters, and at least one physical constraint of the internal combustion engine, and controlling one or more operations based at least in part upon the one or more control commands. The acts of determining the first and second set of parameters and computing the one or more control commands are repeated over a plurality of time periods over which the first set of parameters and the second set of parameters are time variant.

    Abstract translation: 公开了用于基于内燃机和空气处理系统的操作状态计算第一组参数的系统,装置和方法,基于线性时变模型的第二组参数以及一个或多个控制命令 基于在预测水平线上的成本函数的最小化或最大化,所述第二参数集合以及所述内燃机的至少一个物理约束,并且至少部分地基于所述一个或多个控制来控制一个或多个操作 命令。 确定第一和第二组参数并计算一个或多个控制命令的动作在多个时间段内被重复,在多个时间段中,第一组参数和第二组参数是时间变化的。

    OPTIMIZATION-BASED PREDICTIVE METHOD FOR BATTERY CHARGING
    10.
    发明申请
    OPTIMIZATION-BASED PREDICTIVE METHOD FOR BATTERY CHARGING 有权
    基于优化的电池充电预测方法

    公开(公告)号:US20150326037A1

    公开(公告)日:2015-11-12

    申请号:US14273065

    申请日:2014-05-08

    Applicant: Cummins, Inc.

    Abstract: A battery management system for a rechargeable battery includes a battery monitor configured to acquire data regarding the rechargeable battery and a processor. The processor is configured to determine an initial state of charge of the battery based on the acquired data; determine a target state of charge for the battery; determine a plurality of charging solutions to achieve the target state of charge based on an optimization of one variable of the battery of a plurality of variables of the battery; narrow the plurality of charging solutions to charging solutions that meet an objective of each of the remaining plurality of variables of the battery; select the charging solution that corresponds with the fastest charge time for the battery from the charging solutions that meet the objective of each of the plurality of battery variables; and command a controller to regulate an amount of charge to the battery in accord with the selected charging solution.

    Abstract translation: 一种用于可再充电电池的电池管理系统包括:电池监视器,被配置为获取关于可充电电池和处理器的数据。 处理器被配置为基于所获取的数据来确定电池的初始充电状态; 确定电池的目标充电状态; 基于电池的多个变量的电池的一个变量的优化来确定多个充电解决方案以实现目标充电状态; 将多个充电解决方案缩小成满足电池的剩余多个变量中的每一个的目标的充电解决方案; 从满足多个电池变量中的每一个的目标的充电解决方案中选择对应于电池的最快充电时间的充电解决方案; 并指示控制器根据所选择的充电方案来调节对电池的充电量。

Patent Agency Ranking