中科微点-全球专利检索

  1. Login
  2. Sign Up

Search Results

31 records (took 0.033 seconds)

    Simulator-training for automated reinforcement-learning-based application-managers
    21.
    发明授权
    Simulator-training for automated reinforcement-learning-based application-managers 有权

    公开(公告)号：US11238372B2

    公开(公告)日：2022-02-01

    申请号：US16518845

    申请日：2019-07-22

    Applicant: VMware, Inc.

    Inventor： Dev Nag ,  Yanislav Yankov ,  Dongni Wang ,  Gregory T. Burk ,  Nicholas Mark Grant Stephen

    IPC: G06N20/00 ,  G06K9/62 ,  G06N3/02 ,  G06F30/20

    Abstract: The current document is directed to methods and systems for simulation-based training of automated reinforcement-learning-based application managers. Simulators are generated from data collected from controlled computing environments controlled and may employ any of a variety of different machine-learning models to learn state-transition and reward models. The current disclosed methods and systems provide facilities for visualizing aspects of the models learned by a simulator and for initializing simulator models using domain information. In addition, the currently disclosed simulators employ weighted differences computed from simulator-generated and training-data state transitions for feedback to the machine-learning models to address various biases and deficiencies of commonly employed difference metrics in the context of training automated reinforcement-learning-based application managers.

    Automated reinforcement-learning-based application manager that learns and improves a reward function
    24.
    发明授权
    Automated reinforcement-learning-based application manager that learns and improves a reward function 有权

    公开(公告)号：US10963313B2

    公开(公告)日：2021-03-30

    申请号：US16518763

    申请日：2019-07-22

    Applicant: VMware, Inc.

    Inventor： Dev Nag ,  Yanislav Yankov ,  Dongni Wang ,  Gregory T. Burk ,  Nicholas Mark Grant Stephen

    IPC: G06N3/08 ,  G06F17/16 ,  G06F9/50 ,  G06N3/02 ,  G06N20/00

    Abstract: The current document is directed to automated reinforcement-learning-based application managers that learn and improve the reward function that steers reinforcement-learning-based systems towards optimal or near-optimal policies. Initially, when the automated reinforcement-learning-based application manager is first installed and launched, the automated reinforcement-learning-based application manager may rely on human-application-manager action inputs and resulting state/action trajectories to accumulate sufficient information to generate an initial reward function. During subsequent operation, when it is determined that the automated reinforcement-learning-based application manager is no longer following a policy consistent with the type of management desired by human application managers, the automated reinforcement-learning-based application manager may use accumulated trajectories to improve the reward function.

    TRANSFERABLE TRAINING FOR AUTOMATED REINFORCEMENT-LEARNING-BASED APPLICATION-MANAGERS
    27.
    发明申请
    TRANSFERABLE TRAINING FOR AUTOMATED REINFORCEMENT-LEARNING-BASED APPLICATION-MANAGERS 审中-公开

    公开(公告)号：US20200065670A1

    公开(公告)日：2020-02-27

    申请号：US16518831

    申请日：2019-07-22

    Applicant: VMware, Inc.

    Inventor： Dev Nag ,  Yanislav Yankov ,  Dongni Wang ,  Gregory T. Burk ,  Nicholas Mark Grant Stephen

    IPC: G06N3/08 ,  G06N3/04 ,  G06K9/62 ,  G06F9/30

    Abstract: The current document is directed to transfer of training received by a first automated reinforcement-learning-based application manager while controlling a first application is transferred to a second automated reinforcement-learning-based application manager which controls a second application different from the first application. Transferable training provides a basis for automated generation of applications from application components. Transferable training is obtained from composition of applications from application components and composition of reinforcement-learning-based-control-and-learning constructs from reinforcement-learning-based-control-and-learning constructs of application components.

    SAFE-OPERATION-CONSTRAINED REINFORCEMENT-LEARNING-BASED APPLICATION MANAGER
    28.
    发明申请
    SAFE-OPERATION-CONSTRAINED REINFORCEMENT-LEARNING-BASED APPLICATION MANAGER 审中-公开

    公开(公告)号：US20200065495A1

    公开(公告)日：2020-02-27

    申请号：US16502587

    申请日：2019-07-03

    Applicant: VMware, Inc.

    Inventor： Dev Nag ,  Gregory T. Burk ,  Yanislav Yankov ,  Nicholas Mark Grant Stephen ,  Dongni Wang

    IPC: G06F21/57 ,  G06N20/00

    Abstract: The current document is directed to a safe-operation-constrained reinforcement-learning-based application manager that can be deployed in various different computational environments, without extensive manual modification and interface development, to manage the computational environments with respect to one or more reward-specified goals. Control actions undertaken by the safe-operation-constrained reinforcement-learning-based application manager are constrained, by stored action filters, to constrain state/action-space exploration by the safe-operation-constrained reinforcement-learning-based application manager to safe actions and thus prevent deleterious impact to the managed computational environment.

    AUTOMATED REINFORCEMENT-LEARNING-BASED APPLICATION MANAGER THAT LEARNS AND IMPROVES A REWARD FUNCTION
    29.
    发明申请
    AUTOMATED REINFORCEMENT-LEARNING-BASED APPLICATION MANAGER THAT LEARNS AND IMPROVES A REWARD FUNCTION 审中-公开

    公开(公告)号：US20200065157A1

    公开(公告)日：2020-02-27

    申请号：US16518763

    申请日：2019-07-22

    Applicant: VMware, Inc.

    Inventor： Dev Nag ,  Yanislav Yankov ,  Dongni Wang ,  Gregory T. Burk ,  Nicholas Mark Grant Stephen

    IPC: G06F9/50 ,  G06N20/00 ,  G06N3/02 ,  G06F17/16

    Abstract: The current document is directed to automated reinforcement-learning-based application managers that learn and improve the reward function that steers reinforcement-learning-based systems towards optimal or near-optimal policies. Initially, when the automated reinforcement-learning-based application manager is first installed and launched, the automated reinforcement-learning-based application manager may rely on human-application-manager action inputs and resulting state/action trajectories to accumulate sufficient information to generate an initial reward function. During subsequent operation, when it is determined that the automated reinforcement-learning-based application manager is no longer following a policy consistent with the type of management desired by human application managers, the automated reinforcement-learning-based application manager may use accumulated trajectories to improve the reward function.

    ADMINISTRATOR-MONITORED REINFORCEMENT-LEARNING-BASED APPLICATION MANAGER
    30.
    发明申请
    ADMINISTRATOR-MONITORED REINFORCEMENT-LEARNING-BASED APPLICATION MANAGER 审中-公开

    公开(公告)号：US20200065118A1

    公开(公告)日：2020-02-27

    申请号：US16518617

    申请日：2019-07-22

    Applicant: VMware, Inc.

    Inventor： Dev Nag ,  Yanislav Yankov ,  Dongni Wang ,  Gregory T. Burk ,  Nicholas Mark Grant Stephen

    IPC: G06F9/445 ,  G06N20/00 ,  G06F9/48 ,  G06F17/16

    Abstract: The current document is directed to an administrator-monitored reinforcement-learning-based application manager that can be deployed in various different computational environments to manage the computational environments with respect to one or more reward-specified goals. Certain control actions undertaken by the administrator-monitored reinforcement-learning-based application manager are first proposed, to one or more administrators or other users, who can accept or reject the proposed control actions prior to their execution. The reinforcement-learning-based application manager can therefore continue to explore the state/action space, but the exploration can be parametrically constrained as well as by human-administrator oversight and intervention.

Patent Agency Ranking