Autoscaling nodes of a stateful application based on role-based autoscaling policies

    公开(公告)号:US12124888B2

    公开(公告)日:2024-10-22

    申请号:US18342998

    申请日:2023-06-28

    CPC classification number: G06F9/5077 G06F2209/505

    Abstract: Example implementations relate to a role-based autoscaling approach for scaling of nodes of a stateful application in a large scale virtual data processing (LSVDP) environment. Information is received regarding a role performed by the nodes of a virtual cluster of an LSVDP environment on which a stateful application is or will be deployed. Role-based autoscaling policies are maintained defining conditions under which the roles are to be scaled. A policy for a first role upon which a second role is dependent specifies a condition for scaling out the first role by a first step and a second step by which the second role is to be scaled out in tandem. When load information for the first role meets the condition, nodes in the virtual cluster that perform the first role are increased by the first step and nodes that perform the second role are increased by the second step.

    Management of dependencies between clusters in a computing environment

    公开(公告)号:US11347562B2

    公开(公告)日:2022-05-31

    申请号:US16506952

    申请日:2019-07-09

    Inventor: Joel Baxter

    Abstract: Described herein are systems, methods, and software to manage configurations between dependent clusters. In one implementation, a management system maintains a data structure that indicates relationships between clusters in a computing environment. The management system further identifies a configuration modification to a first cluster and identifies other clusters associated with the first cluster based on the data structure. Once the other clusters are identified, the management system may determine configuration modifications for the other clusters based on the data structure and initiate deployment of the configuration modifications.

    Enhanced configuration management of data processing clusters

    公开(公告)号:US11281551B2

    公开(公告)日:2022-03-22

    申请号:US16376057

    申请日:2019-04-05

    Inventor: Joel Baxter

    Abstract: Described herein are systems, methods, and software to enhance the management and deployment of data processing clusters in a computing environment. In one example, a management system may monitor data processing efficiency information for a cluster and determine when the efficiency meets efficiency criteria. When the efficiency criteria are met, the management system may identify a new configuration for the cluster and initiate an operation to implement the new configuration for the cluster.

    Data connectors in large scale processing clusters

    公开(公告)号:US11042665B2

    公开(公告)日:2021-06-22

    申请号:US14532289

    申请日:2014-11-04

    Abstract: Systems, methods, and software described herein facilitate interfacing between processing nodes and a plurality of data repositories. In one example, a method of interfacing between a processing node and a plurality of data repositories includes identifying, for the processing node, a data access request using a first data access format, wherein the data access request includes a data connector identifier. The method further includes translating the access request to a second data access format based on the data connector identifier, and identifying a data repository in the plurality of data repositories to service the data access request based on the data connector identifier. The method also provides accessing data for the data access request in the data repository via the second data access format.

    Allocating edge services with large-scale processing framework clusters

    公开(公告)号:US10455028B2

    公开(公告)日:2019-10-22

    申请号:US15001735

    申请日:2016-01-20

    Inventor: Joel Baxter

    Abstract: Systems, methods, and software described herein enhance the generation of large-scale processing framework clusters and corresponding edge services. In one implementation, a method includes identifying a request for a large-scale processing cluster, and identifying one or more edge services based on the type and version of the large-scale processing cluster. The method further provides generating a user interface that indicates the one or more edge services available, receiving a selection of at least one edge service in the one or more edge services, and initiating execution of the large-scale processing framework cluster and the at least one edge service, wherein the at least one edge service is provided with configuration information for the large-scale processing framework cluster.

    Allocating cache memory on a per data object basis

    公开(公告)号:US10534714B2

    公开(公告)日:2020-01-14

    申请号:US14575976

    申请日:2014-12-18

    Abstract: Systems, methods, and software described herein allocate cache memory to job processes executing on a processing node. In one example, a method of allocating cache memory to a plurality of job process includes identifying the plurality of job processes executing on a processing node, and identifying a data object to be accessed by the plurality of job processes. The method further provides allocating a portion of the cache memory to each job process in the plurality of job processes and, for each job process in the plurality of job processes, identifying a segment of data from the data object, wherein the segment of data comprises a requested portion of data and a predicted portion of data. The method also includes providing the segments of data to the allocated portions of the cache memory.

Patent Agency Ranking