公开(公告)号：US20210397593A1

公开(公告)日：2021-12-23

申请号：US17463514

申请日：2021-08-31

Applicant: SNOWFLAKE INC.

Inventor： Allison Lee ,  Shrainik Jain ,  Qiuye Jin ,  Stratis Viglas ,  Jiaqi Yan

IPC: G06F16/21 ,  G06F11/34 ,  G06F11/07 ,  G06F16/215 ,  G06F11/30 ,  G06F16/2453

Abstract: A baseline run of a workload and a target run of the workload are compared to identify whether there is a performance regression in the target run, wherein the target run implements a feature that is not implemented in the baseline run. In response to identifying the performance regression, the target run is executed to identify whether the performance regression still exists. The performance regression is flagged as a false positive in response to identifying that the performance regression no longer exists when the target run is executed.

公开(公告)号：US20190294596A1

公开(公告)日：2019-09-26

申请号：US16359452

申请日：2019-03-20

Applicant: Snowflake Inc.

Inventor： Jiaqi Yan ,  Qiuye Jin ,  Shrainik Jain ,  Stralis Viglas ,  Allison Lee

IPC: G06F16/21 ,  G06F11/34 ,  G06F16/2453 ,  G06F16/215 ,  G06F11/30 ,  G06F11/07

Abstract: Systems, methods, and devices for incremental feature development and workload capture in database systems are disclosed. A method includes determining a workload having one or more historical client queries to be rerun for testing the feature, wherein the feature comprises procedural logic. The method further includes executing a baseline run of the workload that does not implement the feature and executing a target run of the workload while implementing the feature. The method further includes comparing the baseline run and the target run to identify whether there is a performance regression in the target run. The method further includes, in response to identifying the performance regression, rerunning the target run to identify whether the performance regression still exists.

公开(公告)号：US11416463B1

公开(公告)日：2022-08-16

申请号：US17721938

申请日：2022-04-15

Applicant: Snowflake Inc.

Inventor： Jiaqi Yan ,  Qiuye Jin ,  Shrainik Jain ,  Stratis Viglas ,  Allison Lee

IPC: G06F16/21 ,  G06F11/34 ,  G06F16/2453 ,  G06F16/215 ,  G06F11/30 ,  G06F11/07

Abstract: Systems, methods, and devices for incremental feature development and workload capture in database systems are disclosed. The method includes determining a workload based on one or more client queries to be rerun for testing the feature release. The method further includes repeatedly executing a test run of the workload to identify whether there is a performance difference in the test run. The method further includes re-execute, in response to identifying the performance difference, the test run using resources with a different concurrency to identify whether the performance difference still exists. The method further includes flagging the performance difference as a false positive in response to identifying that the performance difference no longer exists when the test run is re-executed using the resources with different concurrency.

公开(公告)号：US12216628B2

公开(公告)日：2025-02-04

申请号：US18470706

申请日：2023-09-20

Applicant: SNOWFLAKE INC.

Inventor： Allison Lee ,  Shrainik Jain ,  Qiuye Jin ,  Stratis Viglas ,  Jiaqi Yan

IPC: G06F16/00 ,  G06F11/07 ,  G06F11/30 ,  G06F11/34 ,  G06F16/21 ,  G06F16/215 ,  G06F16/2453

Abstract: A system to identify optimal cloud resources for executing workloads. The system deduplicates historical client queries based on a workload selection configuration to determine a grouping of historical client queries. The system generates a workload based on at least a portion of the grouping of historical client queries. The system repeatedly executes a test run of the workload using resources of a cloud environment to determine whether there is a performance difference in the test run. The system, in response to determining that there is no performance difference, identifies one or more sets of decreased resources of the cloud environment. The system re-executes the test run using the one or more sets of decreased resources of the cloud environment to determine whether there is a performance difference in the test run that is attributed to the one or more sets of decreased resources of the cloud environment.

公开(公告)号：US11500838B1

公开(公告)日：2022-11-15

申请号：US17869071

申请日：2022-07-20

Applicant: Snowflake Inc.

Inventor： Jiaqi Yan ,  Qiuye Jin ,  Shrainik Jain ,  Stratis Viglas ,  Allison Lee

IPC: G06F16/21 ,  G06F11/34 ,  G06F11/07 ,  G06F16/215 ,  G06F11/30 ,  G06F16/2453

Abstract: Systems, methods, and devices for feature release and workload capture in database systems are disclosed. The method includes determining a workload based on one or more client queries to be rerun to test a feature that is unreleased to one or more database clients. The method includes repeatedly executing a test run of the workload to determine a stability factor of the test run. The method includes re-executing, in response to determining the stability factor of the test run, the test run using resources with a different concurrency to confirm the stability factor of the test run. The method includes releasing the feature to the one or more database clients in response to confirming the stability factor of the test run.

公开(公告)号：US20220318215A1

公开(公告)日：2022-10-06

申请号：US17842642

申请日：2022-06-16

Applicant: SNOWFLAKE INC.

Inventor： Allison Lee ,  Shrainik Jain ,  Qiuye Jin ,  Stratis Viglas ,  Jiaqi Yan

IPC: G06F16/21 ,  G06F11/34 ,  G06F11/07 ,  G06F16/215 ,  G06F11/30 ,  G06F16/2453

Abstract: A system to repeatedly execute a test run of a workload using resources of a cloud environment to determine whether there is a performance difference in the test run. The system to, in response to determining that there is no performance difference, identify one or more sets of decreased resources of the cloud environment. The system to re-execute the test run using the one or more sets of decreased resources of the cloud environment to determine whether there is a performance difference in the test run that is attributed to the one or more sets of decreased resources of the cloud environment. The system to determine minimum resources of the cloud environment to repeatedly execute the test run using the minimum resources without existence of a performance difference in response to re-executing the test run using the one or more sets of decreased resources of the cloud environment.

公开(公告)号：US11321290B2

公开(公告)日：2022-05-03

申请号：US16359452

申请日：2019-03-20

Applicant: Snowflake Inc.

Inventor： Jiaqi Yan ,  Qiuye Jin ,  Shrainik Jain ,  Stratis Viglas ,  Allison Lee

IPC: G06F16/21 ,  G06F11/34 ,  G06F11/07 ,  G06F16/215 ,  G06F11/30 ,  G06F16/2453

Abstract: Systems, methods, and devices for incremental feature development and workload capture in database systems are disclosed. A method includes determining a workload having one or more historical client queries to be rerun for testing the feature, wherein the feature comprises procedural logic. The method further includes executing a baseline run of the workload that does not implement the feature and executing a target run of the workload while implementing the feature. The method further includes comparing the baseline run and the target run to identify whether there is a performance regression in the target run. The method further includes, in response to identifying the performance regression, rerunning the target run to identify whether the performance regression still exists.

公开(公告)号：US20220237161A1

公开(公告)日：2022-07-28

申请号：US17721938

申请日：2022-04-15

Applicant: Snowflake Inc.

Inventor： Jiaqi Yan ,  Qiuye Jin ,  Shrainik Jain ,  Stratis Viglas ,  Allison Lee

IPC: G06F16/21 ,  G06F11/34 ,  G06F11/07 ,  G06F16/215 ,  G06F11/30 ,  G06F16/2453

Abstract: Systems, methods, and devices for incremental feature development and workload capture in database systems are disclosed. The method includes determining a workload based on one or more client queries to be rerun for testing the feature release. The method further includes repeatedly executing a test run of the workload to identify whether there is a performance difference in the test run. The method further includes re-execute, in response to identifying the performance difference, the test run using resources with a different concurrency to identify whether the performance difference still exists. The method further includes flagging the performance difference as a false positive in response to identifying that the performance difference no longer exists when the test run is re-executed using the resources with different concurrency.

公开(公告)号：US11386059B2

公开(公告)日：2022-07-12

申请号：US17463514

申请日：2021-08-31

Applicant: SNOWFLAKE INC.

Inventor： Allison Lee ,  Shrainik Jain ,  Qiuye Jin ,  Stratis Viglas ,  Jiaqi Yan

IPC: G06F16/00 ,  G06F16/21 ,  G06F11/34 ,  G06F11/07 ,  G06F16/215 ,  G06F11/30 ,  G06F16/2453

Abstract: A baseline run of a workload and a target run of the workload are compared to identify whether there is a performance regression in the target run, wherein the target run implements a feature that is not implemented in the baseline run. In response to identifying the performance regression, the target run is executed to identify whether the performance regression still exists. The performance regression is flagged as a false positive in response to identifying that the performance regression no longer exists when the target run is executed.

公开(公告)号：US11138167B2

公开(公告)日：2021-10-05

申请号：US16943274

申请日：2020-07-30

Applicant: SNOWFLAKE INC.

Inventor： Allison Lee ,  Shrainik Jain ,  Qiuye Jin ,  Stratis Viglas ,  Jiaqi Yan

IPC: G06F16/00 ,  G06F16/21 ,  G06F11/34 ,  G06F11/07 ,  G06F16/215 ,  G06F11/30 ,  G06F16/2453

Abstract: A baseline run of a workload and a target run of the workload are compared to identify whether there is a performance regression in the target run, wherein the target run implements a feature that is not implemented in the baseline run. In response to identifying the performance regression, the target run is executed to identify whether the performance regression still exists. The performance regression is flagged as a false positive in response to identifying that the performance regression no longer exists when the target run is executed.