Optimizing Data Placement Based on Data Temperature and Lifetime Prediction

    公开(公告)号:US20230185457A1

    公开(公告)日:2023-06-15

    申请号:US17644085

    申请日:2021-12-13

    Applicant: Google LLC

    CPC classification number: G06F3/0616 G06N5/04 G06F3/0659 G06F3/0673

    Abstract: A method for optimizing data storage includes obtaining a data object for storage at memory hardware in communication with data processing hardware. The memory hardware includes a plurality of storage devices, each storage device of the plurality of storage devices including storage parameters different from each other storage device of the plurality of storage devices. The method also includes determining one or more data object parameters associated with the data object and predicting, using a model and the data object parameters and the storage parameters, an object temperature representative of a frequency of access for the data object and an object lifetime representative of an amount of time the data object is to be stored. The method further includes selecting, using the predicted object temperature and object lifetime, one of the storage devices, and storing the data object at the selected one of the storage devices.

    Distributed database configuration

    公开(公告)号:US10831777B2

    公开(公告)日:2020-11-10

    申请号:US15200939

    申请日:2016-07-01

    Applicant: Google LLC

    Abstract: Replicas are selected in a large distributed network, and the roles for these replicas are identified. In one example, a leader is selected from among candidate computing clusters. To make this selection, an activity monitor predicts or monitors the workload of one or more clients. Different activities of the workload are given corresponding weights. The delay in performing requested activities, modified by these weights is found, and the candidate leader with the lowest weighted delay is selected as the leader.

    DISTRIBUTED DATABASE CONFIGURATION

    公开(公告)号:US20210034641A1

    公开(公告)日:2021-02-04

    申请号:US17074578

    申请日:2020-10-19

    Applicant: Google LLC

    Abstract: Replicas are selected in a large distributed network, and the roles for these replicas are identified. In one example, a leader is selected from among candidate computing dusters. To make this selection, an activity monitor predicts or monitors the workload of one or more clients. Different activities of the workload are given corresponding weights. The delay in performing requested activities, modified by these weights is found, and the candidate leader with the lowest weighted delay is selected as the leader.

    Weighted auto-sharding
    6.
    发明授权

    公开(公告)号:US10530844B2

    公开(公告)日:2020-01-07

    申请号:US15428844

    申请日:2017-02-09

    Applicant: Google LLC

    Abstract: Methods, systems, and apparatus for automatic sharding and load balancing in a distributed data processing system. In one aspect, a method includes determining workload distribution for an application across worker computers and in response to determining a load balancing operation is required: selecting a first worker computer having a highest load measure relative to respective load measure of the other work computers; determining one or more move operations for a partition of data assigned to the first worker computer and a weight for each move operation; and selecting the move operation with a highest weight the selected move operation.

Patent Agency Ranking