Abstract:
Disclosed herein are system, method, and computer program product embodiments for providing extension points to alter a data source in a data pipeline. By providing a before-state-change extension point, a data orchestration system may allow connected clients to aggregate delta from a changed state source, allowing the data orchestration system to include only changed or added data in a transferred data state. By providing an after-state-change extension point, a data orchestration system may harness additional customizations, for example, effectively and efficiently handle changes to the state made by a viewing client following the transmission of a delta of changes.
Abstract:
Example methods and systems are directed to a multitenant application server using a union file system. Each tenant has one or more users and a tenant layer in the union file system. Each user has a user layer in the union file system. The union file system provides a logical file system to each user based on the user layer, the tenant layer, and a base layer comprising a set of application layers. A first user shares an application template file with other users of the same tenant by moving the file from the first user's user layer to the tenant layer. After the file is moved, all users of the tenant have access to the application defined by the application template file. The moving of the file is achieved by modifying metadata for the file.
Abstract:
In an example embodiment, a solution is used to provide for a highly efficient application installer. A software packaging format, known as vSolution, is provided that allows software developers to ship multiple artefacts of different types in a single container. Unlike traditional mechanisms, this container does not contain a dedicated installer executable or any sort of installation routine. Rather, the container format encourages a declarative approach to describe what an installation routine should perform, via the organization of the artefacts based on content type and using a naming convention.
Abstract:
Example methods and systems are directed to providing an abstraction layer to deployed applications, so that the applications can concentrate on building their domain-specific functionality and not have to worry about scalability. In an example embodiment, Kubernetes is used as a form of distributed operating system that the system controls on one side and that is deployed on the other side. It works as an abstraction for the end-users to be able to scale applications and persistent data for various tenants, route requests to correct applications, maintain metadata, and monitor the cluster.
Abstract:
Example methods and systems are directed to providing an abstraction layer to deployed applications, so that the applications can concentrate on building their domain-specific functionality and not have to worry about scalability. In an example embodiment, Kubernetes is used as a form of distributed operating system that the system controls on one side and that is deployed on the other side. It works as an abstraction for the end-users to be able to scale applications and persistent data for various tenants, route requests to correct applications, maintain metadata, and monitor the cluster.
Abstract:
A method for executing a data processing pipeline may be provided. The method may include identifying a file providing a runtime environment required for executing a series of data processing operations comprising the data processing pipeline. The file may be identified based on one or more tags associated with the data processing pipeline. The one or more tags may specify at least one runtime requirement for the series of data processing operations. The file may be executed to generate an executable package that includes a plurality of components required for executing the series of data processing operations. The series of data processing operations included in the data processing pipeline may be executed by at least executing the executable package to provide the runtime environment required for executing the series of data processing operations. Related systems and articles of manufacture, including computer program products, are also provided.
Abstract:
A method for executing a data processing pipeline may be provided. The method may include identifying a file providing a runtime environment required for executing a series of data processing operations comprising the data processing pipeline. The file may be identified based on one or more tags associated with the data processing pipeline. The one or more tags may specify at least one runtime requirement for the series of data processing operations. The file may be executed to generate an executable package that includes a plurality of components required for executing the series of data processing operations. The series of data processing operations included in the data processing pipeline may be executed by at least executing the executable package to provide the runtime environment required for executing the series of data processing operations. Related systems and articles of manufacture, including computer program products, are also provided.
Abstract:
A method may include receiving, from a client, a request to customize an operator node corresponding to a data processing operation. The request may include a first key. The operator node may be selected for inclusion in a graph representative of a data processing pipeline. The operator node may be associated with a first file that includes at least one configuration parameter associated with the operator node. The at least one configuration parameter may be associated with a second key. In response to the first key being determined to match the second key, the operator node may be customized by modifying the at least one configuration parameter. Furthermore, a second file associated with a customized operator node may be generated to store the customizations made to the operator node including the modification of the at least one configuration parameter. Related systems and articles of manufacture are also provided.
Abstract:
A client database manager can cause a memory of a client device on a client side of a network to store a first component, a second component, and a relationship value representing a dependent relationship between the first component and the second component. A client processing module can cause a processor to receive, after the storing, a request to process the first component at the client device. The client database manager can send to the server side of the network a request for an update of at least one of the first component or the second component. The client processing module can cause the processor to process at the client device, before receiving a response to the request for the update from the server side of the network, at least a portion of the first component and at least a portion of the second component based on the relationship value.