-
公开(公告)号：US20200327114A1
公开(公告)日：2020-10-15
申请号：US16914075
申请日：2020-06-26
Applicant: Amazon Technologies, Inc.
Inventor： Anurag Windlass Gupta , Neal Fachan , Samuel James McKelvie , Laurion Darrell Burchall , Christopher Richard Newcombe , Pradeep Jnana Madhavarapu , Benjamin Tobler , James McClellan Corey
Abstract: A database system may include a database service and a separate distributed storage service. The database service (or a database engine head node thereof) may be responsible for query parsing, optimization, and execution, transactionality, and consistency, while the storage service may be responsible for generating data pages from redo log records and for durability of those data pages. For example, in response to a write request directed to a particular data page, the database engine head node may generate a redo log record and send it, but not the data page, to a storage service node. The storage service node may store the redo log record and return a write acknowledgement to the database service prior to applying the redo log record. The server node may apply the redo log record and other redo log records to a previously stored version of the data page to create a current version.
-
公开(公告)号：US10360195B1
公开(公告)日：2019-07-23
申请号：US13928242
申请日：2013-06-26
Applicant: Amazon Technologies, Inc.
Inventor： Samuel James McKelvie , James McClellan Corey , Yan Valerie Leshinsky
Abstract: A database management system may utilize a log-structured storage system instead of a conventional storage system. The log-structured storage system may store a baseline of an object and a series of log entries describing changes to the object. At various positions in the log, a combined record may be written to contain a description of a change to the object and a copy of the corresponding version of the object. Combined records may be used to employ alternative strategies for constructing or transmitting a version of an object. Embodiments may employ these alternative strategies for replication and data caches.
-
公开(公告)号：US20180046552A1
公开(公告)日：2018-02-15
申请号：US15728271
申请日：2017-10-09
Applicant: Amazon Technologies, Inc.
Inventor： Pradeep Jnana Madhavarapu , Anurag Windlass Gupta , Yan Valerie Leshinsky , Samuel James McKelvie , James McClellan Corey
CPC classification number: G06F11/1446 , G06F11/1464 , G06F11/1471 , G06F11/1662 , G06F11/2094 , G06F11/2097 , G06F2201/80
Abstract: A log-structured data store implementing data backup may implement variable data replication. Write requests may be received at different storage nodes maintaining respective replicas of a portion of a log for data maintained in the log-structured data store. Log records indicating the write requests may be stored in the respective replicas of the log portions at the different storage nodes. The log records may be sent to a backup data store to be durability persisted as part of an archived version of the log. At some of the storage nodes, in response to determining that the log records have been durably persisted in the backup data store, storage space for the log records may be reclaimed. In other remaining storage nodes, the log records may be retained and made accessible for servicing read requests.
-
Patent Agency Ranking
公开(公告)号：US09817710B2
公开(公告)日：2017-11-14
申请号：US15289907
申请日：2016-10-10
Applicant: Amazon Technologies, Inc.
Inventor： Anurag Windlass Gupta , James McClellan Corey , Yan Valerie Leshinsky , Pradeep Jnana Madhavarapu , Samuel James McKelvie
CPC classification number: G06F11/0793 , G06F3/0619 , G06F3/064 , G06F3/067 , G06F3/0689 , G06F11/0709 , G06F11/0751 , G06F11/0787 , G06F11/079 , G06F11/10 , G06F11/1004 , G06F11/1076
Abstract: Self-describing data blocks of a minimum atomic write size may be stored for a data store. Data may be received for storage in a data block at a persistent storage device. Metadata may be generated for the data that includes an error detection code which is generated for the data and the metadata together. An individual atomic write operation may write together the data and the metadata in the data block. When accessed, the error detection code is applicable to detect errors and the metadata may also be applicable to determine whether the data is stored for a currently assigned purpose or a previously assigned purpose of the data block.
-
公开(公告)号：US09817587B1
公开(公告)日：2017-11-14
申请号：US14638898
申请日：2015-03-04
Applicant: Amazon Technologies, Inc.
Inventor： Yan Valerie Leshinsky , James McClellan Corey , Mustafa Abrar
CPC classification number: G06F3/0617 , G06F3/064 , G06F3/065 , G06F3/0688 , G06F17/30309
Abstract: A data store maintaining data may implement memory-based on-demand data page generation. Log records may be maintained in system memory according to a version threshold for data pages of data stored in persistent storage. When a request for a version of a particular data page is received that is within the version threshold, the data page may be obtained from persistent storage and log records associated with the data page may be applied to the data page to generate the requested version of the data page. The version threshold for the data pages may change, and log records in system memory may be identified for coalesce operations. The coalesce operations may be efficiently performed (e.g., in the background), updating the data pages in persistent storage to include the changes of the identified log records and space in system memory for the identified log records may be reclaimed.
-
公开(公告)号：US09723064B1
公开(公告)日：2017-08-01
申请号：US14475200
申请日：2014-09-02
Applicant: Amazon Technologies, Inc.
Inventor： Samuel James McKelvie , Anurag Windlass Gupta , Pradeep Jnana Madhavarapu , James McClellan Corey , Yan Valerie Leshinsky
CPC classification number: H04L67/10 , H04L67/1095 , H04L67/1097 , H04L67/42
Abstract: Hybrid quorum policies may be implemented for access requests to state maintained in a distributed system. An update to state maintained in a distributed system may be sent to multiple nodes in the distributed system maintain the state in order to satisfy a hybrid quorum policy for updating the state in the distributed system. The hybrid quorum policy may include individual quorum policies for multiple quorum sets including nodes of the distributed system. Acknowledgments received from nodes in the distributed system indicating that the update is performed may be evaluated according to the individual quorum policies to determine whether the hybrid quorum policy is satisfied. If the hybrid quorum policy is satisfied, then the update to the state may be considered durable.
-
公开(公告)号：US09251003B1
公开(公告)日：2016-02-02
申请号：US13967185
申请日：2013-08-14
Applicant: Amazon Technologies, Inc.
Inventor： Anurag Windlass Gupta , Pradeep Jnana Madhavarapu , Matthew David Allen , Laurion Darrell Burchall , James McClellan Corey
CPC classification number: G06F11/1469 , G06F11/1438 , G06F11/1441 , G06F17/30132 , G06F2201/80 , G06F2201/82 , G06F2201/84
Abstract: A database system may implement database cache survivability across database failures. In various embodiments, a database cache may be maintained independent of a failure of a database. A database cache may be maintained in a non-volatile memory device or maintained in a shared memory segment of system memory. Upon recovery from a database failure, a recovery point may be determined that indicates a consistent state of the database. Cache entries of the database cache inconsistent with the consistent state of the database may be invalidated, and the database cache may be made available for access requests directed toward the database. Valid cache entries from before the database failure may be made available without accessing a back-end data store for the database.
Abstract translation: 数据库系统可以跨数据库故障实现数据库缓存生存性。 在各种实施例中，可以独立于数据库的故障来维护数据库高速缓存。 可以将数据库高速缓存维护在非易失性存储器设备中或者维护在系统存储器的共享存储器段中。 从数据库故障恢复时，可以确定指示数据库一致状态的恢复点。 与数据库的一致状态不一致的数据库缓存的缓存条目可能被无效，并且数据库高速缓存可能被用于针对数据库的访问请求。 数据库故障之前的有效缓存条目可以在不访问数据库的后端数据存储的情况下可用。
-
公开(公告)号：US09223843B1
公开(公告)日：2015-12-29
申请号：US14094154
申请日：2013-12-02
Applicant: Amazon Technologies, Inc.
Inventor： Pradeep Jnana Madhavarapu , Raman Mittal , Benjamin Tobler , James McClellan Corey , Yan Valerie Leshinsky , Samuel James McKelvie , Anurag Windlass Gupta
IPC: G06F17/30
CPC classification number: G06F17/30371 , G06F17/30368 , G06F17/30578
Abstract: A log-structured data store may implement optimized log storage for asynchronous log updates. In some embodiments, log records may be received indicating updates to data stored for a storage client and indicating positions in a log record sequence. The log records themselves may not be guaranteed to be received according to the log record sequence. Received log records may be stored in a hot log portion of a block-based storage device according to an order in which they are received. Log records in the hot log portion may then be identified to be moved to a cold log portion of the block-based storage device in order to complete a next portion of the log record sequence. Log records may be modified, such as compressed, or coalesced, before being stored together in a data block of the cold log portion according to the log record sequence.
Abstract translation: 日志结构化数据存储可以实现用于异步日志更新的优化日志存储。 在一些实施例中，可以接收指示对存储用于存储客户端的数据的更新并指示日志记录序列中的位置的日志记录。 可能无法保证根据日志记录顺序接收日志记录。 接收到的日志记录可以根据它们被接收的顺序存储在基于块的存储设备的热日志部分中。 然后可以将热日志部分中的日志记录识别为移动到基于块的存储设备的冷日志部分，以便完成日志记录序列的下一部分。 可以根据日志记录序列将日志记录修改，例如压缩或合并，然后一起存储在冷日志部分的数据块中。
-
-
-
-
-
-
-
Search Results
28
records
(took 0.032 seconds)
