公开(公告)号：US12093326B2

公开(公告)日：2024-09-17

申请号：US18384964

申请日：2023-10-30

Applicant: eBay Inc.

Inventor： Sizhong Liu ,  Zou Qingnan ,  Yi Liu ,  Ian Chi-Yee Ma ,  Haowen Zhu

IPC: G06F16/906 ,  G06F9/38 ,  G06F16/182 ,  G06F16/9035 ,  G06F16/907

CPC classification number: G06F16/906 ,  G06F9/3838 ,  G06F16/182 ,  G06F16/9035 ,  G06F16/907

Abstract: Software is increasingly being developed as a collection of loosely coupled applications. Loosely coupled applications exchange data by publishing data to and retrieving data from a data store, such as a database, a file located on a storage cluster, etc. Data produced by one application and consumed by another is referred to as a data dependency. In some embodiments, an application's data dependencies are identified by analyzing cached query plans associated with the application. Query plans include a hierarchical representation of a query, where non-leaf nodes represent commands and leaf nodes identify data dependencies. An application's data dependencies are identified by traversing the hierarchical representation of the query. Data dependencies consumed by the application are identified by finding leaf nodes that descend from a read command, while data dependencies produced by the application are identified by finding leaf nodes that descend from a write command.

公开(公告)号：US20240061888A1

公开(公告)日：2024-02-22

申请号：US18384964

申请日：2023-10-30

Applicant: eBay Inc.

Inventor： Sizhong Liu ,  Zou Qingnan ,  YI Liu ,  Ian Chi-Yee MA ,  Haowen Zhu

IPC: G06F16/906 ,  G06F16/9035 ,  G06F16/182 ,  G06F9/38 ,  G06F16/907

CPC classification number: G06F16/906 ,  G06F16/9035 ,  G06F16/182 ,  G06F9/3838 ,  G06F16/907

Abstract: Software is increasingly being developed as a collection of loosely coupled applications. Loosely coupled applications exchange data by publishing data to and retrieving data from a data store, such as a database, a file located on a storage cluster, etc. Data produced by one application and consumed by another is referred to as a data dependency. In some embodiments, an application's data dependencies are identified by analyzing cached query plans associated with the application. Query plans include a hierarchical representation of a query, where non-leaf nodes represent commands and leaf nodes identify data dependencies. An application's data dependencies are identified by traversing the hierarchical representation of the query. Data dependencies consumed by the application are identified by finding leaf nodes that descend from a read command, while data dependencies produced by the application are identified by finding leaf nodes that descend from a write command.

公开(公告)号：US20220171811A1

公开(公告)日：2022-06-02

申请号：US17672307

申请日：2022-02-15

Applicant: eBay Inc.

Inventor： Sizhong Liu ,  Zou Qingnan ,  YI Liu ,  Ian Chi-Yee MA ,  Haowen Zhu

IPC: G06F16/906 ,  G06F16/9035 ,  G06F16/182 ,  G06F9/38 ,  G06F16/907

Abstract: Software is increasingly being developed as a collection of loosely coupled applications. Loosely coupled applications exchange data by publishing data to and retrieving data from a data store, such as a database, a file located on a storage cluster, etc. Data produced by one application and consumed by another is referred to as a data dependency. In some embodiments, an application's data dependencies are identified by analyzing cached query plans associated with the application. Query plans include a hierarchical representation of a query, where non-leaf nodes represent commands and leaf nodes identify data dependencies. An application's data dependencies are identified by traversing the hierarchical representation of the query. Data dependencies consumed by the application are identified by finding leaf nodes that descend from a read command, while data dependencies produced by the application are identified by finding leaf nodes that descend from a write command.

公开(公告)号：US11301517B2

公开(公告)日：2022-04-12

申请号：US16869522

申请日：2020-05-07

Applicant: eBay Inc.

Inventor： Sizhong Liu ,  Zou Qingnan ,  Yi Liu ,  Ian Chi-Yee Ma ,  Haowen Zhu

IPC: G06F16/906 ,  G06F16/9035 ,  G06F16/182 ,  G06F9/38 ,  G06F16/907

Abstract: Software is increasingly being developed as a collection of loosely coupled applications. Loosely coupled applications exchange data by publishing data to and retrieving data from a data store, such as a database, a file located on a storage cluster, etc. Data produced by one application and consumed by another is referred to as a data dependency. In some embodiments, an application's data dependencies are identified by analyzing cached query plans associated with the application. Query plans include a hierarchical representation of a query, where non-leaf nodes represent commands and leaf nodes identify data dependencies. An application's data dependencies are identified by traversing the hierarchical representation of the query. Data dependencies consumed by the application are identified by finding leaf nodes that descend from a read command, while data dependencies produced by the application are identified by finding leaf nodes that descend from a write command.

公开(公告)号：US11836190B2

公开(公告)日：2023-12-05

申请号：US17672307

申请日：2022-02-15

Applicant: eBay Inc.

Inventor： Sizhong Liu ,  Zou Qingnan ,  Yi Liu ,  Ian Chi-Yee Ma ,  Haowen Zhu

IPC: G06F16/906 ,  G06F16/9035 ,  G06F16/182 ,  G06F9/38 ,  G06F16/907

CPC classification number: G06F16/906 ,  G06F9/3838 ,  G06F16/182 ,  G06F16/907 ,  G06F16/9035

Abstract: Software is increasingly being developed as a collection of loosely coupled applications. Loosely coupled applications exchange data by publishing data to and retrieving data from a data store, such as a database, a file located on a storage cluster, etc. Data produced by one application and consumed by another is referred to as a data dependency. In some embodiments, an application's data dependencies are identified by analyzing cached query plans associated with the application. Query plans include a hierarchical representation of a query, where non-leaf nodes represent commands and leaf nodes identify data dependencies. An application's data dependencies are identified by traversing the hierarchical representation of the query. Data dependencies consumed by the application are identified by finding leaf nodes that descend from a read command, while data dependencies produced by the application are identified by finding leaf nodes that descend from a write command.

公开(公告)号：US11734291B2

公开(公告)日：2023-08-22

申请号：US17076267

申请日：2020-10-21

Applicant: eBay Inc.

Inventor： Yi Liu ,  Qingyu Ji ,  Bin Li ,  Sizhong Liu ,  Haowen Zhu ,  Peijun Xu ,  Chinmaya Dubey

IPC: G06F16/00 ,  G06F16/2458 ,  G06F16/248 ,  G06F16/2455

CPC classification number: G06F16/2471 ,  G06F16/248 ,  G06F16/2455

Abstract: Methods, systems, and computer storage media are provided for providing an application programming interface (“API”) for executing a query are provided. The API call, scheduling, and assignment processing engines may generate and schedule assignments, along with associated dataset portions, based on the query. Based on the assignments and datasets, the assignments may be scheduled for execution by processes of nodes in a distributed system. The API call and query may also include implementation instructions that require storing dataset portions into memory that is associated with a process executing the assignment for an in-memory database implementation. As the assignment is executed using a dataset portion that is stored on memory associated with a process, results may be stored in a file. Once each assignment has been executed and has a result file, the result files are merged to provide results of the query and API call to the user.