Methods And Apparatus For Implementing Reinforcement Learning

    公开(公告)号:US20240311687A1

    公开(公告)日:2024-09-19

    申请号:US18272956

    申请日:2021-01-18

    摘要: Methods and apparatus for implementing reinforcement learning (RL) are provided. A method of operation for a node implementing RL, wherein the node instructs actions in an environment in accordance with a policy generated by a RL agent, wherein the RL agent models the environment and encodes a state of the environment using a set of features, comprises obtaining an intent, wherein the intent specifies one or more criteria to be satisfied by the environment. The method further comprises determining a Companion Markov Decision Process (CMDP) that encodes states of the environment using a subset of the set of features used by the RL agent. The method further comprises generating a finite state automaton that represents the intent as a series of logic states, and computing a product of CMDP output states and logic states, wherein the product contains all of the potential combinations of a CMDP output state and a logic state. The method further comprises selecting an action to be performed on the environment from one or more suggested actions obtained from the policy, the selection being based on the product of CMDP output states and logic state.

    DEVICE AUTHENTICATION IN A COMMUNICATION NETWORK

    公开(公告)号:US20230171597A1

    公开(公告)日:2023-06-01

    申请号:US17917576

    申请日:2020-04-08

    摘要: According to an aspect, there is provided a method of operating an analysis node. The method comprises receiving, from a network node in a first communication network to which a first wireless device is attached, behaviour information relating to the behaviour of the first wireless device with respect to the first communication network during a time period following attachment of the first wireless device to the first communication network; analysing the received behaviour information with reference to predetermined behaviour information for wireless devices owned by one or more third parties to determine whether the first wireless device is owned by one of the third parties; and sending an indication of whether the first wireless device is to be authenticated in the first communication network, wherein the indication is based on whether the first wireless device is determined to be owned by one of the third parties.

    COORDINATING MANAGEMENT OF A PLURALITY OF CELLS IN A CELLULAR COMMUNICATION NETWORK

    公开(公告)号:US20240205698A1

    公开(公告)日:2024-06-20

    申请号:US18285677

    申请日:2021-04-21

    IPC分类号: H04W24/02

    CPC分类号: H04W24/02

    摘要: A computer implemented method is disclosed for coordinating management of a plurality of cells in a cellular communication network, wherein each of the plurality of cells is managed by a respective Agent. The method comprises assembling a candidate set of cells, wherein each cell in the candidate set is awaiting execution of an action selected for the cell by its managing Agent. The method further comprises selecting a cell from the candidate set, adding the selected cell to an execution set of cells, and removing, from the candidate set of cells, the selected cell and all cells identified in a topology graph of the plurality of cells as fulfilling an interference condition with respect to the selected cell. The method further comprises, if a scheduling condition is fulfilled, initiating, for all cells in the execution set of cells, execution of the actions selected for the cells by their managing agents.