公开(公告)号：US11797447B2

公开(公告)日：2023-10-24

申请号：US17204899

申请日：2021-03-17

Applicant: Hewlett Packard Enterprise Development LP

Inventor： Xiongbing Ou ,  Thomas Anthony Phelan ,  David Lee

IPC: G06F12/0811 ,  G06F16/182 ,  G06F12/121 ,  G06F9/54

CPC classification number: G06F12/0811 ,  G06F12/121 ,  G06F16/182 ,  G06F9/541 ,  G06F2212/1021

Abstract: Embodiments described herein are generally directed to caching and data access improvements in a large scale data processing environment. According to an example, an agent running on a first worker node of a cluster receives a read request from a task. The worker node of the cluster to which the data at issue is mapped is identified. When the first worker node is the identified worker node, it is determined whether its cache contains the data; if so, the data is fetched from a remote data lake and the agent locally caches the data; otherwise, when the identified worker node is another worker node of the compute cluster, the data is fetched from a remote agent of that worker node. The agent responds to the read request with cached data, data returned by the remote data lake, or data returned by the remote data agent as the case may be.

公开(公告)号：US11698820B2

公开(公告)日：2023-07-11

申请号：US16800024

申请日：2020-02-25

Applicant: Hewlett Packard Enterprise Development LP

Inventor： Xiongbing Ou ,  Lakshm inarayanan Gunaseelan ,  Joel Baxter ,  Swami Viswanathan

IPC: G06F9/50

CPC classification number: G06F9/5077 ,  G06F2209/505

Abstract: Example implementations relate to a role-based autoscaling approach for scaling of nodes of a stateful application in a large scale virtual data processing (LSVDP) environment. Information is received regarding a role performed by the nodes of a virtual cluster of an LSVDP environment on which a stateful application is or will be deployed. Role-based autoscaling policies are maintained defining conditions under which the roles are to be scaled. A policy for a first role upon which a second role is dependent specifies a condition for scaling out the first role by a first step and a second step by which the second role is to be scaled out in tandem. When load information for the first role meets the condition, nodes in the virtual cluster that perform the first role are increased by the first step and nodes that perform the second role are increased by the second step.