公开(公告)号：US20190286615A1

公开(公告)日：2019-09-19

申请号：US16434376

申请日：2019-06-07

Applicant: Google LLC

Inventor： Murray M Stokely ,  Arif Merchant

IPC: G06F16/17 ,  G06F16/182 ,  G06F3/06

Abstract: A method includes receiving trace data representing access information about files stored in a large-scale distributed storage system, identifying file access patterns based on the trace data, receiving metadata information associated with the files stored in the large-scale distributed storage system, and generating a preferred storage parameter for each file based on the received metadata information and the identified file access patterns. The method also includes receiving, file reliability or accessibility information of a new file, determining whether the received file reliability or accessibility information of the new file matches information of a file group of the files in the large-scale distributed storage system, and when the file reliability or accessibility information of the new file matches the information of the file group, storing the new file in the large-scale distributed storage system using the preferred storage parameter associated with the file group.

公开(公告)号：US11838356B2

公开(公告)日：2023-12-05

申请号：US17663618

申请日：2022-05-16

Applicant: Google LLC

Inventor： Alexander Shraer ,  Kfir Lev-Ari ,  Arif Merchant ,  Vishesh Khemani ,  Atul Adya

IPC: H04L67/1001 ,  G06F9/50 ,  G06F16/00 ,  G06F16/27 ,  H04L43/08 ,  H04L67/148

CPC classification number: H04L67/1001 ,  G06F9/5066 ,  G06F9/5083 ,  G06F9/5088 ,  G06F16/00 ,  G06F16/278 ,  H04L43/08 ,  H04L67/148 ,  G06F2209/5017

Abstract: Methods, systems, and apparatus for automatic sharding and load balancing in a distributed data processing system. In one aspect, a method includes determining workload distribution for an application across worker computers and in response to determining a load balancing operation is required: selecting a first worker computer having a highest load measure relative to respective load measure of the other work computers; determining one or more move operations for a partition of data assigned to the first worker computer and a weight for each move operation; and selecting the move operation with a highest weight the selected move operation.

公开(公告)号：US20210390104A1

公开(公告)日：2021-12-16

申请号：US16899180

申请日：2020-06-11

Applicant: Google LLC

Inventor： Arif Merchant ,  Tzu-Wei Yang ,  Mustafa Uysal

IPC: G06F16/2455 ,  G06F16/2453 ,  G06F16/22 ,  G06F9/30 ,  G06F12/02 ,  G06F12/0813

Abstract: The technology is directed to cache admission control. One or more processors may categorize access requests for data items in a cache storage into a plurality of categories and collect information on the access requests over time. Based on the collected information, a utility value for caching data items in each category of the plurality of categories may be determined. Newly requested data items may be admitted into the cache storage in an order according to the corresponding utility values of their respective categories.