Dynamic self-reconfiguration of nodes in a processing pipeline

    公开(公告)号:US11475007B2

    公开(公告)日:2022-10-18

    申请号:US17195010

    申请日:2021-03-08

    Abstract: A query optimization system is described that, at runtime, optimizes the execution pipeline generated for a query. Based upon communications between nodes in the execution pipeline, the execution pipeline generated for a query is optimized by modifying the execution pipeline to create a modified execution pipeline. The modified execution pipeline is then executed to execute the query and results obtained for the query. The changes or modifications made to an execution pipeline may include changing the capabilities (e.g., changes to inputs and/or outputs of a node, changing the task(s) or function(s) performed by the node) of one or more nodes within the execution pipeline. The changes may include changing the position of one or more nodes within a directed acyclic graph representing the execution pipeline.

    COMBINED SORT AND AGGREGATION
    2.
    发明申请

    公开(公告)号:US20200250194A1

    公开(公告)日:2020-08-06

    申请号:US16854397

    申请日:2020-04-21

    Abstract: Innovative techniques are disclosed for performing a combined sort and aggregation operation involving eagerly performing aggregation while sorting. The techniques described herein enable an aggregation and a group-by operation to be performed using an amount of system memory that is far less than the system memory required to store all the data records being processed while minimizing the need to spill data to disk. This combined sort and aggregation operation has better performance than conventional techniques since system memory is used more efficiently. In certain embodiments, a combined sort and aggregation operation is disclosed that enables the efficient sorting and aggregation of data records when the desired aggregation function is composable (such as SUM, COUNT, MIN and MAX aggregate operations).

    Combined sort and aggregation
    3.
    发明授权

    公开(公告)号:US10691695B2

    公开(公告)日:2020-06-23

    申请号:US15951002

    申请日:2018-04-11

    Abstract: Innovative techniques are disclosed for performing a combined sort and aggregation operation involving eagerly performing aggregation while sorting. The techniques described herein enable an aggregation and a group-by operation to be performed using an amount of system memory that is far less than the system memory required to store all the data records being processed while minimizing the need to spill data to disk. This combined sort and aggregation operation has better performance than conventional techniques since system memory is used more efficiently. In certain embodiments, a combined sort and aggregation operation is disclosed that enables the efficient sorting and aggregation of data records when the desired aggregation function is composable (such as SUM, COUNT, MIN and MAX aggregate operations).

    DYNAMIC SELF-RECONFIGURATION OF NODES IN A PROCESSING PIPELINE

    公开(公告)号:US20180329956A1

    公开(公告)日:2018-11-15

    申请号:US15977816

    申请日:2018-05-11

    CPC classification number: G06F17/30474 G06F9/3867 G06F9/44505 G06F17/30477

    Abstract: A query optimization system is described that, at runtime, optimizes the execution pipeline generated for a query. Based upon communications between nodes in the execution pipeline, the execution pipeline generated for a query is optimized by modifying the execution pipeline to create a modified execution pipeline. The modified execution pipeline is then executed to execute the query and results obtained for the query. The changes or modifications made to an execution pipeline may include changing the capabilities (e.g., changes to inputs and/or outputs of a node, changing the task(s) or function(s) performed by the node) of one or more nodes within the execution pipeline. The changes may include changing the position of one or more nodes within a directed acyclic graph representing the execution pipeline.

    Uploading external files and associating them with existing data models

    公开(公告)号:US11741118B2

    公开(公告)日:2023-08-29

    申请号:US17727141

    申请日:2022-04-22

    CPC classification number: G06F16/25

    Abstract: A computer-implemented method includes providing a fixed portion of a data model, uploading external files to an extended portion of the data model, matching at least some parts of the external files to the fixed portions of the data model, and using data from both the fixed and extended portions of the data model together. A computer-implemented method includes receiving a query from a user to a data model that includes a stored subject area portion and a stored extended subject area portion, accessing at least one storage to retrieve the subject area portion and the extended subject area portion, joining relevant portions of the subject area and extended subject area, extracting answers to the query from the joined portions, and reporting the answers to the user.

    Uploading external files and associating them with existing data models

    公开(公告)号:US11314760B2

    公开(公告)日:2022-04-26

    申请号:US14862539

    申请日:2015-09-23

    Abstract: A computer-implemented method includes providing a fixed portion of a data model, uploading external files to an extended portion of the data model, matching at least some parts of the external files to the fixed portions of the data model, and using data from both the fixed and extended portions of the data model together. A computer-implemented method includes receiving a query from a user to a data model that includes a stored subject area portion and a stored extended subject area portion, accessing at least one storage to retrieve the subject area portion and the extended subject area portion, joining relevant portions of the subject area and extended subject area, extracting answers to the query from the joined portions, and reporting the answers to the user.

    Dynamic self-reconfiguration of nodes in a processing pipeline

    公开(公告)号:US10970284B2

    公开(公告)日:2021-04-06

    申请号:US15977816

    申请日:2018-05-11

    Abstract: A query optimization system is described that, at runtime, optimizes the execution pipeline generated for a query. Based upon communications between nodes in the execution pipeline, the execution pipeline generated for a query is optimized by modifying the execution pipeline to create a modified execution pipeline. The modified execution pipeline is then executed to execute the query and results obtained for the query. The changes or modifications made to an execution pipeline may include changing the capabilities (e.g., changes to inputs and/or outputs of a node, changing the task(s) or function(s) performed by the node) of one or more nodes within the execution pipeline. The changes may include changing the position of one or more nodes within a directed acyclic graph representing the execution pipeline.

    DYNAMIC SELF-RECONFIGURATION OF NODES IN A PROCESSING PIPELINE

    公开(公告)号:US20210191944A1

    公开(公告)日:2021-06-24

    申请号:US17195010

    申请日:2021-03-08

    Abstract: A query optimization system is described that, at runtime, optimizes the execution pipeline generated for a query. Based upon communications between nodes in the execution pipeline, the execution pipeline generated for a query is optimized by modifying the execution pipeline to create a modified execution pipeline. The modified execution pipeline is then executed to execute the query and results obtained for the query. The changes or modifications made to an execution pipeline may include changing the capabilities (e.g., changes to inputs and/or outputs of a node, changing the task(s) or function(s) performed by the node) of one or more nodes within the execution pipeline. The changes may include changing the position of one or more nodes within a directed acyclic graph representing the execution pipeline.

    Dynamic lifecycle management of temporary storage schemas

    公开(公告)号:US10956379B2

    公开(公告)日:2021-03-23

    申请号:US15961671

    申请日:2018-04-24

    Abstract: Techniques are described that enable the dynamic and automatic life cycle management of database schemas. Temporary database schemas are dynamically and automatically allocated in response to database schema requests. Allocated schemas are also automatically reclaimed upon expiration. A dynamic schema allocation system is provided that is configured to receive database schema requests from one or more clients and dynamically and automatically, substantially free of any manual intervention, serve database schemas in response to the requests. The database schemas may be allocated from multiple database instances available to the dynamic schema allocation system. Attributes specified in a database schema request may be used to find a matching database instance and a schema is allocated for the request from the matching database instance.

Patent Agency Ranking