Hybrid Reinforcement Learning (RL) to Control a Water Distribution Network

    公开(公告)号:US20250021060A1

    公开(公告)日:2025-01-16

    申请号:US18760741

    申请日:2024-07-01

    Applicant: Autodesk, Inc.

    Abstract: A method and system control a water distribution network. A database is maintained of prior states based on a residential water demand, a tank level, and an energy tariff. A current state of the water distribution network is determined. Rewards are determined and include a tank level constraint, an energy cost, and a toggle count. A query based model is used to determine a set of control points used to control a first prior state. An RL agent is trained based on the prior states and rewards. The RL agent determines a control setpoint (that changes the pump speed) that maintains the tank level, minimizes the energy cost, and complies with the toggle count. The RL agent determines time slots and selects one of the time slots. Hybrid setpoints are generated to control the water distribution network within the selected time slot.

    Automated Layout Design for Building Game Worlds

    公开(公告)号:US20250083049A1

    公开(公告)日:2025-03-13

    申请号:US18882607

    申请日:2024-09-11

    Applicant: Autodesk, Inc.

    Abstract: A method and system provide the ability to build a game world. A story is obtained that provides a textual narrative of a sequence of events. Plot facilities and a set of constraints are extracted from the story. Each of the plot facilities is a conceptual location where an event happens in the story. Each constraint defines a spatial relation between plot facilities. A map is generated based on the set of constraints by: generating a terrain of two dimensional (2D) polygons that is each associated with a biome type, and assigning each plot facility to a point on the terrain. The assigning complies with a maximum number of constraints and utilizes reinforcement learning (RL) to optimize positions of the points.

Patent Agency Ranking