公开(公告)号：US20230177345A1

公开(公告)日：2023-06-08

申请号：US17545403

申请日：2021-12-08

Applicant: VMware, Inc.

Inventor： Marius Vilcu ,  Dongni Wang ,  Asmitha Rathis ,  Greg Burk

IPC: G06N3/08 ,  G06N3/04 ,  G06F9/50

CPC classification number: G06N3/088 ,  G06N3/04 ,  G06F9/505

Abstract: The current document is directed to methods and systems that determine workload characteristics of computational entities from stored data and that evaluate deployment/configuration policies in order to facilitate deploying, launching, and controlling distributed applications, distributed-application components, and other computational entities within distributed computer systems. Deployment/configuration policies are powerful tools for assisting managers and administrators of distributed applications and distributed computer systems, but constructing deployment/configuration policies and, in particular, evaluating the relative effectiveness of deployment/configuration policies in increasingly complex distributed-computer-system environments may be difficult or practically infeasible for many administrators and managers and may be associated with undesirable or intolerable levels of risk. The currently disclosed machine-learning-based deployment/configuration-policy evaluation methods and systems represent a significant improvement to policy-based management and control that address both of these problems.

公开(公告)号：US20240046069A1

公开(公告)日：2024-02-08

申请号：US17970830

申请日：2022-10-21

Applicant: VMWARE, INC.

Inventor： MARIUS VILCU ,  Peter Rudy ,  Asmitha Rathis ,  Aiswaryaa Venugopalan

IPC: G06N3/04

CPC classification number: G06N3/0454

Abstract: The current document is directed to reinforcement-learning-based management-system agents that control distributed applications and the infrastructure environments in which they run. Management-system agents are initially trained in simulated environments and specialized training environments before being deployed to live, target distributed computer systems where they operate in a controller mode in which they do not explore the control-state space or attempt to learn better policies and value functions, but instead produce traces that are collected and stored for subsequent use. Each deployed management-system agent is associated with a twin training agent that uses the collected traces produced by the deployed management-system agent for optimizing its policy and value functions. To further ensure safe operational control of the environment, the management-system agents employ lookahead planning, action budgets, and action constraints to forestall issuance, by management-system controllers, of potentially deleterious actions.

公开(公告)号：US20240419457A1

公开(公告)日：2024-12-19

申请号：US18210032

申请日：2023-06-14

Applicant: VMware, Inc.

Inventor： Dongni Wang ,  Aiswaryaa Venugopalan ,  Arnav Chakravarthy ,  Marius Vilcu ,  Asmitha Rathis ,  Greg Burk

IPC: G06F9/445 ,  G06F9/50

Abstract: The disclosure provides a method for determining a target configuration for a container-based cluster. The method generally includes determining, by a virtualization management platform configured to manage components of the cluster, a current state of the cluster, determining, by the virtualization management platform, at least one of performance metrics or resource utilization metrics for the cluster based on the current state of the cluster, processing, with a model configured to generate candidate configurations recommended for the cluster, the current state and at least one of the performance metrics or the resource utilization metrics and thereby generate the candidate configurations, calculating a reward score for each of the candidate configurations, selecting the target configuration as a candidate configuration from the candidate configurations based on the reward score of the target configuration, and adjusting configuration settings for the cluster based on the target configuration to alter the current state of the cluster.

公开(公告)号：US20230161635A1

公开(公告)日：2023-05-25

申请号：US17532876

申请日：2021-11-22

Applicant: VMware, Inc.

Inventor： Marius VILCU ,  Dongni Wang ,  Asmitha Rathis ,  Greg Burk

IPC: G06F9/50 ,  G06K9/62 ,  G06N3/04

CPC classification number: G06F9/5055 ,  G06K9/6262 ,  G06N3/0454

Abstract: The current document is directed to a reinforcement-learning-based application manager that controls the operation of one or more applications and that employs transfer learning to improve initialization and operation of the reinforcement-learning-based application manager and to improve operation of the one or more distributed computer systems that host the applications controlled by the reinforcement-learning-based application manager. Transfer learning, in the disclosed implementations, is achieved by logically decomposing machine-learning-based function approximators for reinforcement-learning functions into component-specific function approximators, storing pre-trained function approximators and pre-trained component-specific function approximators, and initializing function approximators for reinforcement-learning-based application managers using the stored pre-trained function approximators and pre-trained component-specific function approximators.