Preventing reader starvation during order preserving data stream consumption

    公开(公告)号:US10728186B2

    公开(公告)日:2020-07-28

    申请号:US15604019

    申请日:2017-05-24

    Applicant: SAP SE

    Abstract: The present disclosure involves systems, software, and computer implemented methods for preventing reader starvation in a distributed system. One example method includes receiving, at a node that manages a data stream, a write-intent request from a writer for a first partition, the data stream associated with a graph that includes levels of partitions including a current level; identifying the first partition for the writer; providing partition information for the first partition to enable the writer to write to the first partition; determining that the writer has previously written to a second partition associated with the current level; in response to determining that the writer has previously written to the second partition: creating a new current level; associating the first partition with the new current level; identifying partitions associated with the current level; and providing a close-level instruction to each local node that includes a partition associated with the current level.

    TRACE MESSAGING FOR DISTRIBUTED EXECUTION OF DATA PROCESSING PIPELINES

    公开(公告)号:US20190384659A1

    公开(公告)日:2019-12-19

    申请号:US16010018

    申请日:2018-06-15

    Applicant: SAP SE

    Abstract: A method for routing trace messages during an execution of a data processing pipeline is provided. The method may include receiving, at a master node, a request from a client to receive trace messages output by a worker node executing at least a portion of the data processing pipeline. The master node and the worker node may be part of a distributed cluster of computing nodes. The trace messages may correspond to events occurring during the execution of at least the portion of the data processing pipeline. The master node may respond to the request by subscribing to a trace stream published by the worker node. The trace stream may include the trace messages output by the worker node. The master node may generate a user interface for displaying, at the client, the trace messages. Related systems and articles of manufacture, including computer program products, are also provided.

    PREVENTING READER STARVATION DURING ORDER PRESERVING DATA STREAM CONSUMPTION

    公开(公告)号:US20180343213A1

    公开(公告)日:2018-11-29

    申请号:US15604019

    申请日:2017-05-24

    Applicant: SAP SE

    Abstract: The present disclosure involves systems, software, and computer implemented methods for preventing reader starvation in a distributed system. One example method includes receiving, at a node that manages a data stream, a write-intent request from a writer for a first partition, the data stream associated with a graph that includes levels of partitions including a current level; identifying the first partition for the writer; providing partition information for the first partition to enable the writer to write to the first partition; determining that the writer has previously written to a second partition associated with the current level; in response to determining that the writer has previously written to the second partition: creating a new current level; associating the first partition with the new current level; identifying partitions associated with the current level; and providing a close-level instruction to each local node that includes a partition associated with the current level.

    STATIC HIERARCHY BASED QUERY EXECUTION
    26.
    发明申请

    公开(公告)号:US20180081941A1

    公开(公告)日:2018-03-22

    申请号:US15272851

    申请日:2016-09-22

    Applicant: SAP SE

    CPC classification number: G06F16/24542 G06F9/4881 G06F9/5066

    Abstract: In one respect, there is provided a distributed database system that includes a global scheduler node and a first local scheduler node. The global scheduler node can be configured to generate an execution plan for a query requiring data stored at and/or managed by a first and a second worker node assigned to the first local scheduler node. The execution plan can include a first fragment having operations to be performed by the first and second worker node. The first local scheduler node can be configured to coordinate the execution of a portion of the first fragment of the execution plan by distributing, to the first and second worker node, operations included in the first fragment of the execution plan, and routing, between the first and second worker node, messages associated with executing the first fragment of the execution plan. Related methods and computer program products are also provided.

    Integrated Application Server and Data Server Processes with Matching Data Formats

    公开(公告)号:US20230042944A1

    公开(公告)日:2023-02-09

    申请号:US17967660

    申请日:2022-10-17

    Applicant: SAP SE

    Abstract: In one embodiment, the present invention includes a computer-implemented method comprising storing data in an application using an application custom data type and application custom data structure. The data is stored in a database using the application custom data type and the application custom data structure. In one embodiment, a request is sent to access the data from the application to the database. The data is retrieved from the database in response to the request in the application custom data type and the application custom data structure. In one embodiment, the data is sent from the database to a shared memory in the application custom data type and the application custom data structure and the data is retrieved by the application from the shared memory in the application custom data type and the application custom data structure.

    Data processing pipeline engine
    29.
    发明授权

    公开(公告)号:US11275485B2

    公开(公告)日:2022-03-15

    申请号:US16010009

    申请日:2018-06-15

    Applicant: SAP SE

    Abstract: A method for generating a data processing pipeline is provided. The method may include generating a user interface for displaying, at a client, a first operator node and a second operator node. The first operator node and the second operator node may each correspond to a data processing operation. In response to one or more inputs received from the client via the user interface, the first operator node and/or the second operator node may be added to a graph displayed in the user interface. The graph may be representative of a data processing pipeline. The first operator node and the second operator node may further be interconnected with an directed edge. The data processing pipeline may be generated based on the graph. Related systems and articles of manufacture, including computer program products, are also provided.

    Metadata versioning in a distributed database

    公开(公告)号:US10545929B2

    公开(公告)日:2020-01-28

    申请号:US15253750

    申请日:2016-08-31

    Applicant: SAP SE

    Abstract: In one respect, there is provided a distributed database system. The distributed database system can include a plurality of nodes and a plurality of optimizers. A first optimizer of the plurality of optimizers can be configured to: receive, from a client, a command; generate, based at least in part on global metadata cached by the first optimizer, an execution plan for fulfilling the command that includes one or more tasks to be performed by at least a first node of the plurality of nodes; determine that at least one task of the one or more tasks are not successfully performed by the first node; and in response to determining that at least one task of the one or more tasks are not successfully performed by the first node, updating the cached global metadata at the first optimizer.

Patent Agency Ranking