公开(公告)号：US11860942B1

公开(公告)日：2024-01-02

申请号：US15595688

申请日：2017-05-15

Applicant: Amazon Technologies, Inc.

Inventor： Omer Baluch ,  Julio Delgado Mangas ,  Kiran-Kumar Muniswamy Reddy ,  Ajay Gopalakrishnan ,  Antoun Joubran Kanawati ,  Si Yin ,  Mukul Vijay Karnik ,  Vishal Parakh ,  Timothy Andrew Rath ,  Bhupinder Singh Sidana ,  Jared Scott Lundell

IPC: G06F16/9032 ,  G06N20/00 ,  G06F16/33 ,  G06F16/48 ,  G06F16/35 ,  G06F16/955 ,  G06N5/01

CPC classification number: G06F16/90324 ,  G06F16/33 ,  G06F16/355 ,  G06F16/48 ,  G06F16/955 ,  G06N5/01 ,  G06N20/00

Abstract: Prediction logic analyzes previous data usage activities of a customer process running on a host machine to generate a first prediction indicating that the customer process will request a first data set at a first time. The prediction logic retrieves the first data set from long-term storage and loads the first data set into memory on the host machine in advance of the first time in order to provide the customer process with access to first data set in the memory during a period between the first time and a second time. The prediction logic further generates a second prediction indicating that the customer process will not access the first data set for a threshold period of time after the second time and stores the first data set in the long-term storage at the second time.

公开(公告)号：US20210406279A1

公开(公告)日：2021-12-30

申请号：US17472445

申请日：2021-09-10

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Andrew Rath ,  David Alan Lutz

IPC: G06F16/27 ,  G06F16/182

Abstract: A system that implements a data storage service may store data on behalf of clients in multiple replicas on respective computing nodes. The system may employ an external service to select a master replica for a replica group. The master replica may service consistent read operations and/or write operations that are directed to the replica group (or to a data partition stored by the replica group). The master replica may employ a quorum based mechanism for performing replicated write operations, and a local lease mechanism for determining the replica authorized to perform consistent reads, even when the external service is unavailable. The master replica may propagate local leases to replica group members as replicated writes. If another replica assumes mastership for the replica group, it may not begin servicing consistent read operations that are directed to the replica group until the lease period for a current local lease expires.

公开(公告)号：US20210103604A1

公开(公告)日：2021-04-08

申请号：US17019047

申请日：2020-09-11

Applicant: Amazon Technologies, Inc.

Inventor： Swaminathan Sivasubramanian ,  Stefano Stefani ,  Chiranjeeb Buragohain ,  Rande A. Blackman ,  Timothy Andrew Rath ,  Raymond S. Bradford ,  Grant Alexander MacDonald McAlister ,  Jakub Kulesza ,  James R. Hamilton ,  Luis Felipe Cabrera

IPC: G06F16/27 ,  G06F16/20 ,  G06F16/21 ,  G06F16/215 ,  G06F16/25 ,  G06F16/22 ,  G06F9/50 ,  H04L29/08

Abstract: A system that implements a scalable data storage service may maintain tables in a non-relational data store on behalf of clients. The system may provide a Web services interface through which service requests are received, and an API usable to request that a table be created, deleted, or described; that an item be stored, retrieved, deleted, or its attributes modified; or that a table be queried (or scanned) with filtered items and/or their attributes returned. An asynchronous workflow may be invoked to create or delete a table. Items stored in tables may be partitioned and indexed using a simple or composite primary key. The system may not impose pre-defined limits on table size, and may employ a flexible schema. The service may provide a best-effort or committed throughput model. The system may automatically scale and/or re-partition tables in response to detecting workload changes, node failures, or other conditions or anomalies.

公开(公告)号：US20210064476A1

公开(公告)日：2021-03-04

申请号：US17019072

申请日：2020-09-11

Applicant: Amazon Technologies, Inc.

Inventor： Maximiliano Maccanti ,  Timothy Andrew Rath ,  Rama Krishna Sandeep Pokkunuri ,  Akshat Vig ,  Clarence Wing Yin NG ,  Srivaths Badrinath Copparam ,  Rajaprabhu Thiruchi Loganathan ,  Wei Xiao ,  William Alexander Stevenson

IPC: G06F11/14

Abstract: A system that implements a data storage service may store data for a database table in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may back up individual partitions of the table to a remote storage system independently and (in some cases) in parallel, and may update (or create) and store metadata about the table and its partitions on storage nodes of the data storage service and/or in the remote storage system. Backing up each partition may include exporting it from the database in which the table is stored, packaging and compressing the exported partition for upload, and uploading the exported, packaged, and compressed partition to the remote storage system. The remote storage system may be a key-value durable storage system in which each backed-up partition is accessible using its partition identifier as the key.

公开(公告)号：US10812551B1

公开(公告)日：2020-10-20

申请号：US15862422

申请日：2018-01-04

Applicant: Amazon Technologies, Inc.

Inventor： Santosh Kalki ,  Swaminathan Sivasubramanian ,  Srinivasan Sundar Raghavan ,  Timothy Andrew Rath ,  Amol Devgan ,  Mukul Vijay Karnik

IPC: G06F15/16 ,  H04L29/06 ,  H04L29/08 ,  H04L12/26

Abstract: A hosted analytics system may be integrated with transactional data systems and additional data sources such real-time systems and log files. A data processing pipeline may transform data on arrival for incorporation into an n-dimensional cube. Correlation between patterns of events in transactional data may be identified. Upon arrival, new data may be transformed and incorporated into the n-dimensional cube. Similarity between the new data and a previously identified correlation may be determined and flagged.

公开(公告)号：US10712950B2

公开(公告)日：2020-07-14

申请号：US14733851

申请日：2015-06-08

Applicant: Amazon Technologies, Inc.

Inventor： Stefano Stefani ,  Timothy Andrew Rath ,  Chiranjeeb Buragahain ,  Yan Valerie Leshinsky ,  David Alan Lutz ,  Jakub Kulesza ,  Wei Xiao ,  Jai Vasanth

IPC: G06F3/06 ,  G06F16/27

Abstract: A system that implements a scalable data storage service may maintain tables in a data store on behalf of storage service clients. The service may maintain table data in multiple replicas of partitions that are stored on respective computing nodes in the system. In response to detecting an anomaly in the system, detecting a change in data volume on a partition or service request traffic directed to a partition, or receiving a service request from a client to split a partition, the data storage service may create additional copies of a partition replica using a physical copy mechanism. The data storage service may issue a split command defined in an API for the data store to divide the original and additional replicas into multiple replica groups, and to configure each replica group to maintain a respective portion of the table data that was stored in the partition before the split.

公开(公告)号：US20190306255A1

公开(公告)日：2019-10-03

申请号：US16377078

申请日：2019-04-05

Applicant: Amazon Technologies, Inc.

Inventor： Wei Xiao ,  David Alan Lutz ,  Timothy Andrew Rath ,  Maximiliano Maccanti ,  Miguel Mascarenhas Filipe ,  David Craig Yanacek

IPC: H04L29/08 ,  G06F11/34 ,  G06F9/50 ,  H04L29/06

Abstract: A system that provides services to clients may receive and service requests, various ones of which may require different amounts of work. The system may determine whether it is operating in an overloaded or underloaded state based on a current work throughput rate, a target work throughput rate, a maximum request rate, or an actual request rate, and may dynamically adjust the maximum request rate in response. For example, if the maximum request rate is being exceeded, the maximum request rate may be raised or lowered, dependent on the current work throughput rate. If the target or committed work throughput rate is being exceeded, but the maximum request rate is not being exceeded, a lower maximum request rate may be proposed. Adjustments to the maximum request rate may be made using multiple incremental adjustments. Service request tokens may be added to a leaky token bucket at the maximum request rate.

公开(公告)号：US20190079839A1

公开(公告)日：2019-03-14

申请号：US16185423

申请日：2018-11-09

Applicant: Amazon Technologies, Inc.

Inventor： Michael T. Helmick ,  Jakub Kulesza ,  Timothy Andrew Rath ,  Stefano Stefani ,  David Alan Lutz

IPC: G06F11/20 ,  G06F11/00

Abstract: Disclosed are various embodiments for distributing data items within a plurality of nodes. A data item that is subject to a data item update request is updated from a master node to a plurality of slave notes. The update of the data item is determined to be locality-based durable based at least in part on acknowledgements received from the slave nodes. Upon detection that the master node has failed, a new master candidate is determined via an election among the plurality of slave nodes.

公开(公告)号：US20180324033A1

公开(公告)日：2018-11-08

申请号：US16024502

申请日：2018-06-29

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Andrew Rath ,  Jakub Kulesza ,  David Alan Lutz

IPC: H04L12/24 ,  G06F11/20 ,  H04L29/08 ,  G06F11/16 ,  G06F11/14 ,  G06F3/06

CPC classification number: H04L41/0668 ,  G06F3/0617 ,  G06F3/0653 ,  G06F3/0659 ,  G06F3/0683 ,  G06F11/1425 ,  G06F11/1662 ,  G06F11/2028 ,  G06F11/2041 ,  G06F11/2048 ,  G06F11/2094 ,  G06F11/2097 ,  G06F2201/825 ,  H04L67/1097 ,  H04L67/16

Abstract: A system that implements a data storage service may store data on behalf of storage service clients. The system may maintain data in multiple replicas of various partitions that are stored on respective computing nodes in the system. The system may employ a single master failover protocol, usable when a replica attempts to become the master replica for a replica group of which it is a member. Attempting to become the master replica may include acquiring a lock associated with the replica group, and gathering state information from the other replicas in the group. The state information may indicate whether another replica supports the attempt (in which case it is included in a failover quorum) or stores more recent data or metadata than the replica attempting to become the master (in which case synchronization may be required). If the failover quorum includes enough replicas, the replica may become the master.

公开(公告)号：US09882949B1

公开(公告)日：2018-01-30

申请号：US14503077

申请日：2014-09-30

Applicant: Amazon Technologies, Inc.

Inventor： Santosh Kalki ,  Swaminathan Sivasubramanian ,  Srinivasan Sundar Raghavan ,  Timothy Andrew Rath ,  Amol Devgan ,  Mukul Vijay Karnik

IPC: G06F15/16 ,  H04L29/06 ,  H04L12/26 ,  H04L29/08

CPC classification number: H04L65/60 ,  H04L43/18 ,  H04L67/18

Abstract: A hosted analytics system may be integrated with transactional data systems and additional data sources such real-time systems and log files. A data processing pipeline may transform data on arrival for incorporation into an n-dimensional cube. Correlation between patterns of events in transactional data may be identified. Upon arrival, new data may be transformed and incorporated into the n-dimensional cube. Similarity between the new data and a previously identified correlation may be determined and flagged.