REINFORCEMENT LEARNING METHOD AND APPARATUS

    公开(公告)号:US20230037632A1

    公开(公告)日:2023-02-09

    申请号:US17966985

    申请日:2022-10-17

    Abstract: A reinforcement learning method and recognition apparatus includes: obtaining a structure graph, where the structure graph includes structure information that is of an environment or the intelligent agent and that is obtained through learning; inputing a current state of the environment and the structure graph to a policy function of the intelligent agent, where the policy function is used to generate an action in response to the current state and the structure graph, and the policy function of the intelligent agent is a graph neural network; outputing the action to the environment by using the intelligent agent; obtaining, from the environment by using the intelligent agent, a next state and reward data in response to the action; training the intelligent agent through reinforcement learning based on the reward data.

    SERVICE SURVIVABILITY ANALYSIS METHOD AND APPARATUS

    公开(公告)号:US20190342145A1

    公开(公告)日:2019-11-07

    申请号:US16514261

    申请日:2019-07-17

    Abstract: Embodiments of this application provide a service survivability analysis method and apparatus, and relate to the field of communications technologies, so as to shorten duration of service survivability analysis and improve efficiency of the service survivability analysis. The method includes: obtaining a link fault record and network topology information that are in a preset time period; determining a similarity between any two links in all faulty links based on fault occurrence time and fault removal time of the any two links in the link fault record and connection information of network devices on the any two links, to obtain a link similarity matrix; performing clustering on all the faulty links based on the link similarity matrix, to obtain at least one link cluster; and performing survivability analysis on services on at least two preset links based on each of the at least one link cluster.

    COMMUNICATION METHOD AND APPARATUS
    3.
    发明公开

    公开(公告)号:US20240137082A1

    公开(公告)日:2024-04-25

    申请号:US18526282

    申请日:2023-12-01

    CPC classification number: H04B7/0456 H04B7/0452

    Abstract: A communication method and apparatus. A terminal device determines channel state information based on S indexes of S vectors. Each of the S vectors is included in a first vector quantization dictionary. The first vector quantization dictionary includes N1 vectors, where N1 and S are both positive integers. The terminal device sends the channel state information to a network device. Because a vector included in the vector quantization dictionary usually has a relatively large dimension, quantizing channel information by using the first vector quantization dictionary is equivalent to performing dimension expansion on the channel information or maintaining a relatively high dimension. High-precision feedback is implemented by using relatively low signaling overheads.

    DATA STREAM IDENTIFICATION METHOD AND APPARATUS

    公开(公告)号:US20200302216A1

    公开(公告)日:2020-09-24

    申请号:US16894425

    申请日:2020-06-05

    Abstract: This application provides a data stream identification method and apparatus and belongs to the field of Internet technologies. The method includes: obtaining packet transmission attribute information of N consecutive packets in a target data stream; generating feature images of the packet transmission attribute information of the N consecutive packets based on the packet transmission attribute information of the N consecutive packets; and inputting the feature images into a pre-trained image classification model, to obtain a target application identifier corresponding to the target data stream. According to this application, accuracy of identifying an application identifier corresponding to a data stream can be improved.

    METHOD FOR GENERATING ROUTING CONTROL ACTION IN SOFTWARE-DEFINED NETWORK AND RELATED DEVICE

    公开(公告)号:US20190123974A1

    公开(公告)日:2019-04-25

    申请号:US16226577

    申请日:2018-12-19

    Abstract: Embodiments of this application provide a method for generating a routing control action in a software-defined network and a related device, to provide optimum control actions for the SDN. The method includes: obtaining a current network state parameter of the SDN; determining a Q function of the SDN based on the current network state parameter of the SDN and a deep neural network model, where the deep neural network model is determined based on a current topology structure of the SDN; and determining a routing control action for the SDN based on the Q function and a link state parameter of each link in the SDN. In the technical solution, the deep neural network model is combined with a Q-learning algorithm of reinforcement learning, and optimum control actions can be determined.

    System Control Method and Apparatus, Controller, And Control System

    公开(公告)号:US20180150035A1

    公开(公告)日:2018-05-31

    申请号:US15880696

    申请日:2018-01-26

    CPC classification number: G05B13/0265 G05B13/04 G05B13/048 G06N3/126

    Abstract: A system control method includes: receiving a control task; randomly selecting a chromosome from an evolution pool according to the control task, and decoding the chromosome to obtain (N+1) ensemble policies, where the chromosome includes (N+1) gene fragments, each gene fragment uniquely corresponds to an ensemble policy, each ensemble policy uniquely corresponds to a preset function, one ensemble policy is used for assigning a weight to a preset function that uniquely corresponds to the ensemble policy, the evolution pool maintains two or more chromosomes, and N is a positive integer greater than or equal to 1; performing an ensemble calculation according to weights assigned by the (N+1) ensemble policies, to obtain an ensemble control output; and generating a control signal according to the ensemble control output, where the control signal is used for performing system control. disclosure

Patent Agency Ranking