Invention Grant
- Patent Title: Modifying task dependencies at worker nodes using precompiled libraries
-
Application No.: US16396522Application Date: 2019-04-26
-
Publication No.: US11216302B2Publication Date: 2022-01-04
- Inventor: Elden Gregory Bishop , Jeffrey Chao
- Applicant: salesforce.com, inc.
- Applicant Address: US CA San Francisco
- Assignee: salesforce.com, inc.
- Current Assignee: salesforce.com, inc.
- Current Assignee Address: US CA San Francisco
- Agency: Sterne, Kessler, Goldstein & Fox P.L.L.C.
- Main IPC: G06F9/46
- IPC: G06F9/46 ; G06F9/48 ; G06F9/50 ; G06F9/455 ; G06F8/71 ; G06F9/445

Abstract:
The technology disclosed provides a novel and innovative technique for compact deployment of application code to stream processing systems. In particular, the technology disclosed relates to obviating the need of accompanying application code with its dependencies during deployment (i.e., creating fat jars) by operating a stream processing system within a container defined over worker nodes of whole machines and initializing the worker nodes with precompiled dependency libraries having precompiled classes. Accordingly, the application code is deployed to the container without its dependencies, and, once deployed, the application code is linked with the locally stored precompiled dependencies at runtime. In implementations, the application code is deployed to the container running the stream processing system between 300 milliseconds and 6 seconds. This is drastically faster than existing deployment techniques that take anywhere between 5 to 15 minutes for deployment.
Public/Granted literature
- US20190250947A1 Stream Processing Task Deployment Using Precompiled Libraries Public/Granted day:2019-08-15
Information query