-
公开(公告)号：US11037058B2
公开(公告)日：2021-06-15
申请号：US16518831
申请日：2019-07-22
Applicant: VMware, Inc.
Inventor： Dev Nag , Yanislav Yankov , Dongni Wang , Gregory T. Burk , Nicholas Mark Grant Stephen
Abstract: The current document is directed to transfer of training received by a first automated reinforcement-learning-based application manager while controlling a first application is transferred to a second automated reinforcement-learning-based application manager which controls a second application different from the first application. Transferable training provides a basis for automated generation of applications from application components. Transferable training is obtained from composition of applications from application components and composition of reinforcement-learning-based-control-and-learning constructs from reinforcement-learning-based-control-and-learning constructs of application components.
-
公开(公告)号：US10922092B2
公开(公告)日：2021-02-16
申请号：US16518617
申请日：2019-07-22
Applicant: VMware, Inc.
Inventor： Dev Nag , Yanislav Yankov , Dongni Wang , Gregory T. Burk , Nicholas Mark Grant Stephen
Abstract: The current document is directed to an administrator-monitored reinforcement-learning-based application manager that can be deployed in various different computational environments to manage the computational environments with respect to one or more reward-specified goals. Certain control actions undertaken by the administrator-monitored reinforcement-learning-based application manager are first proposed, to one or more administrators or other users, who can accept or reject the proposed control actions prior to their execution. The reinforcement-learning-based application manager can therefore continue to explore the state/action space, but the exploration can be parametrically constrained as well as by human-administrator oversight and intervention.
-
公开(公告)号：US11416364B2
公开(公告)日：2022-08-16
申请号：US17119462
申请日：2020-12-11
Applicant: VMware, Inc.
Inventor： Naira Movses Grigoryan , Arnak Poghosyan , Ashot Nshan Harutyunyan , Clement Pang , Dev Nag
Abstract: The current document is directed to methods and systems that employ distributed-computer-system metrics collected by one or more distributed-computer-system metrics-collection services, call traces collected by one or more call-trace services, and attribute values for distributed-computer-system components to identify attribute dimensions related to anomalous behavior of distributed-computer-system components. In a described implementation, nodes correspond to particular types of system components and node instances are individual components of the component type corresponding to a node. Node instances are associated with attribute values and node are associated with attribute-value spaces defined by attribute dimensions. A set of call traces is partitioned, by clustering. Using attribute values and call traces, attribute dimensions that are likely related to particular anomalous behaviors of distributed-computer-system components are determined by decision-tree-related analyses for each partition and are reported to one or more computational entities to facilitate resolution of the anomalous behaviors.
-
公开(公告)号：US20210303438A1
公开(公告)日：2021-09-30
申请号：US16833102
申请日：2020-03-27
Applicant: VMware, Inc.
Inventor： Dev Nag , Naira Movses Grigoryan , Arnak Poghosyan , Ashot Nshan Harutyunyan
Abstract: The current document is directed to methods and systems that employ distributed-computer-system metrics collected by one or more distributed-computer-system metrics-collection services, call traces collected by one or more call-trace services, and attribute values for distributed-computer-system components to identify attribute dimensions related to anomalous behavior of distributed-computer-system components. In a described implementation, nodes correspond to particular types of system components and node instances are individual components of the component type corresponding to a node. Node instances are associated with attribute values and node are associated with attribute-value spaces defined by attribute dimensions. Using attribute values and call traces, attribute dimensions that are likely related to particular anomalous behaviors of distributed-computer-system components are determined by decision-tree-related analyses and are reported to one or more computational entities to facilitate resolution of the anomalous behaviors.
-
公开(公告)号：US11042640B2
公开(公告)日：2021-06-22
申请号：US16502587
申请日：2019-07-03
Applicant: VMware, Inc.
Inventor： Dev Nag , Gregory T. Burk , Yanislav Yankov , Nicholas Mark Grant Stephen , Dongni Wang
Abstract: The current document is directed to a safe-operation-constrained reinforcement-learning-based application manager that can be deployed in various different computational environments, without extensive manual modification and interface development, to manage the computational environments with respect to one or more reward-specified goals. Control actions undertaken by the safe-operation-constrained reinforcement-learning-based application manager are constrained, by stored action filters, to constrain state/action-space exploration by the safe-operation-constrained reinforcement-learning-based application manager to safe actions and thus prevent deleterious impact to the managed computational environment.
-
Patent Agency Ranking
公开(公告)号：US10977579B2
公开(公告)日：2021-04-13
申请号：US16518807
申请日：2019-07-22
Applicant: VMware, Inc.
Inventor： Dev Nag , Yanislav Yankov , Dongni Wang , Gregory T. Burk , Nicholas Mark Grant Stephen
Abstract: The current document is directed to automated reinforcement-learning-based application managers that that are trained using adversarial training. During adversarial training, potentially disadvantageous next actions are selected for issuance by an automated reinforcement-learning-based application manager at a lower frequency than selection of next actions, according to a policy that is learned to provide optimal or near-optimal control over a computing environment that includes one or more applications controlled by the automated reinforcement-learning-based application manager. By selecting disadvantageous actions, the automated reinforcement-learning-based application manager is forced to explore a much larger subset of the system-state space during training, so that, upon completion of training, the automated reinforcement-learning-based application manager has learned a more robust and complete optimal or near-optimal control policy than had the automated reinforcement-learning-based application manager been trained by simulators or using management actions and computing-environment responses recorded during previous controlled operation of a computing-environment.
-
公开(公告)号：US10949263B2
公开(公告)日：2021-03-16
申请号：US16518717
申请日：2019-07-22
Applicant: VMware, Inc.
Inventor： Dev Nag , Yanislav Yankov , Dongni Wang , Gregory T. Burk , Nicholas Mark Grant Stephen
Abstract: The current document is directed to automated reinforcement-learning-based application managers that obtain increased computational efficiency by reusing learned models and by using human-management experience to truncate state and observation vectors. Learned models of managed environments that receive component-associated inputs can be partially or completely reused for similar environments. Human managers and administrators generally use only a subset of the available metrics in managing an application, and that subset can be used as an initial subset of metrics for learning an optimal or near-optimal control policy by an automated reinforcement-learning-based application manager.
-
公开(公告)号：US10802864B2
公开(公告)日：2020-10-13
申请号：US16261253
申请日：2019-01-29
Applicant: VMware, Inc.
Inventor： Dev Nag , Gregory T. Burk , Janislav Jankov , Nick Stephen , Dongni Wang
Abstract: The current document is directed to a modular reinforcement-learning-based application manager that can be deployed in various different computational environments without extensive modification and interface development. The currently disclosed modular reinforcement-learning-based application manager interfaces to observation and action adapters and metadata that provide a uniform and, in certain implementations, self-describing external interface to the various different computational environments which the modular reinforcement-learning-based application manager may be operated to control. In addition, certain implementations of the currently disclosed modular reinforcement-learning-based application manager interface to a user-specifiable reward-generation interface to allow the rewards that provide feedback from the computational environment to the modular reinforcement-learning-based application manager to be tailored to meet a variety of different user expectations and desired control policies.
-
公开(公告)号：US20210303431A1
公开(公告)日：2021-09-30
申请号：US17119462
申请日：2020-12-11
Applicant: VMware, Inc.
Inventor： Naira Movses Grigoryan , Arnak Poghosyan , Ashot Nshan Harutyunyan , Clement Pang , Dev Nag
Abstract: The current document is directed to methods and systems that employ distributed-computer-system metrics collected by one or more distributed-computer-system metrics-collection services, call traces collected by one or more call-trace services, and attribute values for distributed-computer-system components to identify attribute dimensions related to anomalous behavior of distributed-computer-system components. In a described implementation, nodes correspond to particular types of system components and node instances are individual components of the component type corresponding to a node. Node instances are associated with attribute values and node are associated with attribute-value spaces defined by attribute dimensions. A set of call traces is partitioned, by clustering. Using attribute values and call traces, attribute dimensions that are likely related to particular anomalous behaviors of distributed-computer-system components are determined by decision-tree-related analyses for each partition and are reported to one or more computational entities to facilitate resolution of the anomalous behaviors.
-
公开(公告)号：US11113174B1
公开(公告)日：2021-09-07
申请号：US16833102
申请日：2020-03-27
Applicant: VMware, Inc.
Inventor： Dev Nag , Naira Movses Grigoryan , Arnak Poghosyan , Ashot Nshan Harutyunyan
Abstract: The current document is directed to methods and systems that employ distributed-computer-system metrics collected by one or more distributed-computer-system metrics-collection services, call traces collected by one or more call-trace services, and attribute values for distributed-computer-system components to identify attribute dimensions related to anomalous behavior of distributed-computer-system components. In a described implementation, nodes correspond to particular types of system components and node instances are individual components of the component type corresponding to a node. Node instances are associated with attribute values and node are associated with attribute-value spaces defined by attribute dimensions. Using attribute values and call traces, attribute dimensions that are likely related to particular anomalous behaviors of distributed-computer-system components are determined by decision-tree-related analyses and are reported to one or more computational entities to facilitate resolution of the anomalous behaviors.
-
-
-
-
-
-
-
-
-
Search Results
24
records
(took 0.016 seconds)
