公开(公告)号：US20200341880A1

公开(公告)日：2020-10-29

申请号：US16392892

申请日：2019-04-24

Applicant: Google LLC

Inventor： Mariana Sharp ,  Craig Chambers ,  Jelena Pjesivac-Grbovic ,  Kym Hines ,  Sunghwan Ihm ,  Danijela Mijailovic ,  Ben Walters

IPC: G06F11/34 ,  G06F9/46 ,  G06F11/30

Abstract: Aspects of the disclosure relate to evaluating the rollout of a change to a data processing framework (DPF). A first set of jobs is selected out of a plurality of jobs. The first set of jobs is processed by the DPF with the proposed change enabled and the other jobs of the plurality of jobs by the DPF without the change enabled. A performance cost value is determined for each of the jobs in the first set of jobs processed by the DPF with the proposed change enabled and for each of the other jobs of the plurality of jobs processed by the DPF with the proposed change disabled. Based on the performance cost values of the jobs in the first set of jobs and the performance cost values of the other jobs of the plurality of jobs, a determination is made whether the proposed change is beneficial to the DPF.

公开(公告)号：US11138087B2

公开(公告)日：2021-10-05

申请号：US16392892

申请日：2019-04-24

Applicant: Google LLC

Inventor： Mariana Sharp ,  Craig Chambers ,  Jelena Pjesivac-Grbovic ,  Kym Hines ,  Sunghwan Ihm ,  Danijela Mijailovic ,  Ben Walters

IPC: G06F11/34 ,  G06F11/30 ,  G06F9/46 ,  G06F9/445

Abstract: Aspects of the disclosure relate to evaluating the rollout of a change to a data processing framework (DPF). A first set of jobs is selected out of a plurality of jobs. The first set of jobs is processed by the DPF with the proposed change enabled and the other jobs of the plurality of jobs by the DPF without the change enabled. A performance cost value is determined for each of the jobs in the first set of jobs processed by the DPF with the proposed change enabled and for each of the other jobs of the plurality of jobs processed by the DPF with the proposed change disabled. Based on the performance cost values of the jobs in the first set of jobs and the performance cost values of the other jobs of the plurality of jobs, a determination is made whether the proposed change is beneficial to the DPF.

公开(公告)号：US10732928B1

公开(公告)日：2020-08-04

申请号：US16003997

申请日：2018-06-08

Applicant: Google LLC

Inventor： Tyler Akidau ,  Robert Bradshaw ,  Ben Chambers ,  Craig Chambers ,  Reuven Lax ,  Daniel Mills ,  Frances Perry

IPC: G06F7/00 ,  H04L12/841 ,  H04L12/70

Abstract: A method includes receiving data corresponding one of streaming data or batch data and a content of the received data for computation. The method also includes determining an event time of the data for slicing the data, determining a processing time to output results of the received data, and emitting at least a portion of the results of the received data based on the processing time and the event time.