公开(公告)号：US20210311776A1

公开(公告)日：2021-10-07

申请号：US17164731

申请日：2021-02-01

Applicant: salesforce.com, inc.

Inventor： Brian Jaffery TAJUDDIN ,  Samarpan JAIN ,  Reuben CORNEL ,  Siddhi MEHTA ,  Brian ESSERLIEU ,  Jan Asita FERNANDO ,  Jonathan Mark BRUCE ,  Jay HURST

IPC: G06F9/48 ,  G06F9/50 ,  G06F16/23

Abstract: Techniques and architectures for data ingestion in an environment having a distributed data storage system. A request to import data into the environment. The data to be imported from an external source through an application programming interface (API). The request is analyzed to determine if the request corresponds to a request to import a large data load. The data is staged if the request is for the large data load. Data management jobs are created to cause the data to be stored in one or more nodes of the distributed data storage system. The data management jobs are transmitted to corresponding nodes in the distributed data storage system. The jobs are executed asynchronously to cause the data to be stored in the nodes.

公开(公告)号：US20190227842A1

公开(公告)日：2019-07-25

申请号：US15877374

申请日：2018-01-22

Applicant: salesforce.com, inc.

Inventor： Benson QIU ,  Siddhi MEHTA ,  Aakash PRADEEP ,  Shangkar MAYANGLAMBAM

IPC: G06F9/50 ,  G06F9/48 ,  H04L29/08

Abstract: A server includes a processing device to execute a resource manager to receive, from a client device, a job to complete a data-processing task using processing resources of a data-processing cluster, and configure a scheduler to be associated with the data-processing cluster and to manage sharing the processing resources with at least a second job. The scheduler includes a job queue. The processing device is further to partition the job queue into a delegator queue and an application queue, wherein the delegator queue is associated with a delegator container and the application queue is associated with a child application container. The processing device is further to manage, in completion of the job, the processing resources of the data-processing cluster according to capacities allocated to the delegator queue and to the application queue, respectively.

公开(公告)号：US20180165309A1

公开(公告)日：2018-06-14

申请号：US15374787

申请日：2016-12-09

Applicant: salesforce.com, inc.

Inventor： Brian Jaffery TAJUDDIN ,  Samarpan JAIN ,  Reuben CORNEL ,  Siddhi MEHTA ,  Brian ESSERLIEU ,  Jan Asita FERNANDO ,  Jonathan Mark BRUCE ,  Jay HURST

IPC: G06F17/30 ,  G06F9/48

CPC classification number: G06F9/4881 ,  G06F16/2386 ,  H04L67/1097

Abstract: Techniques and architectures for data ingestion in an environment having a distributed data storage system. A request to import data into the environment. The data to be imported from an external source through an application programming interface (API). The request is analyzed to determine if the request corresponds to a request to import a large data load. The data is staged if the request is for the large data load. Data management jobs are created to cause the data to be stored in one or more nodes of the distributed data storage system. The data management jobs are transmitted to corresponding nodes in the distributed data storage system. The jobs are executed asynchronously to cause the data to be stored in the nodes.