-
公开(公告)号:US09576038B1
公开(公告)日:2017-02-21
申请号:US13865113
申请日:2013-04-17
Applicant: Amazon Technologies, Inc.
Inventor: Xianglong Huang , David Alan Lutz , Wei Xiao , Maximiliano Maccanti , Somasundaram Perianayagam , Rande A. Blackman , Stuart Henry Seelye Marshall
CPC classification number: G06F17/30575
Abstract: A distributed database management system may comprise a plurality of computing nodes. A request to update an item maintained by the system may be acknowledged as durable and committed once an entry corresponding to the request has been written to a log file and quorum among the computing nodes has been achieved. Improved consistency may be achieved by maintaining snapshots of committed item states within queryable in-memory snapshot data structures. Range queries may be performed by merging a secondary index with the snapshots and applying filters. Projections may be completed by retrieving additional data from an item collection maintain on one or more storage devices.
Abstract translation: 分布式数据库管理系统可以包括多个计算节点。 一旦与该请求相对应的条目已经被写入到日志文件中并且已经实现了计算节点之间的仲裁,则更新系统维护的项目的请求可以被确认为持久的并被提交。 通过在可查询的内存中快照数据结构中维护已提交项目状态的快照可以实现改进的一致性。 可以通过将辅助索引与快照合并并应用过滤器来执行范围查询。 可以通过从一个或多个存储设备上的项目集合维护中检索附加数据来完成投影。
-
公开(公告)号:US11769019B1
公开(公告)日:2023-09-26
申请号:US16953205
申请日:2020-11-19
Applicant: Amazon Technologies, Inc.
Inventor: Prashant Mathur , Georgiana Dinu , Anna Currey , Eric J. Nowell , Aakash Upadhyay , Haiyu Yao , Marcello Federico , Yaser Al-Onaizan , Rama Krishna Sandeep Pokkunuri , Jian Wang , Xianglong Huang
Abstract: A translation system receives examples of translations between a first language and a second language. In response to receiving request to translate a source text from the first language to the second language, the system ranks the examples based on the example's applicability to one or more portions of the source text. The system performs additional training of a neural network that was pre-trained to translate from the first language to the second language, where the additional training is based on one or more top-ranking examples. The system translates the source text to the second language using the additionally trained neural network.
-
公开(公告)号:US10102230B1
公开(公告)日:2018-10-16
申请号:US14859069
申请日:2015-09-18
Applicant: Amazon Technologies, Inc.
Inventor: Kiran Kumar Muniswamy Reddy , Wei Xiao , Pejus Manoj Das , Lokendra Singh Panwar , Xianglong Huang
Abstract: A data storage system may implement rate-limiting secondary index creation for an online table. A secondary index may be generated for a table stored in a data store. The table may be incrementally indexed, maintaining the updates determined according to indexing different portions of the table in a queue of pending updates that are subsequently applied at the secondary index. Prior to indexing a portion of the table, an evaluation of a current number of pending updates in the queue of pending updates may be performed with respect to a throttle threshold. If the current number of pending updates exceeds the throttle threshold, then indexing the portion of the table may be throttled. Received updates to previously indexed portions of the table, may be applied to the table and placed in the queue of pending updates without an evaluation of the current number of pending requests.
-
公开(公告)号:US09489443B1
公开(公告)日:2016-11-08
申请号:US13902419
申请日:2013-05-24
Applicant: Amazon Technologies, Inc.
Inventor: Kiran-Kumar Muniswamy-Reddy , Wei Xiao , Stefano Stefani , Xianglong Huang , Clarence Wing Yin Ng , Jai Vasanth
IPC: G06F17/30
CPC classification number: G06F17/30584 , G06F17/30575
Abstract: A system that implements a data storage service may store data in multiple replicated partitions on respective computing nodes on behalf of clients. A storage node may, based on the amount of provisioned resources on a given storage device or logical volume, identify candidate partition management operations to be performed, and may send information about the operations to a central partition management scheduler. The scheduler may apply a global prioritization scheme to determine an order in which to perform the candidate operations. The order may be based on whether the operations include partition splits or partition moves, whether they aim to reduce provisioned storage capacity or reduce throughput capacity on a storage device or logical volume, whether they conflict with each other, whether the total number of partitions (or replicas thereof) involved in partition management at any given time exceeds a pre-determined limit, or whether they were requested by clients.
Abstract translation: 实现数据存储服务的系统可以代表客户端将数据存储在各个计算节点上的多个复制分区中。 存储节点可以基于给定存储设备或逻辑卷上的供应资源量来识别要执行的候选分区管理操作,并且可以向中央分区管理调度器发送关于操作的信息。 调度器可以应用全局优先级方案来确定执行候选操作的顺序。 该顺序可以基于操作是否包括分区划分或分区移动,无论它们旨在减少存储设备或逻辑卷上的配置存储容量还是减少吞吐量容量,无论它们是否相互冲突,是否是分区的总数( 或其副本)在任何给定时间内涉及分区管理超过预定限制,或者是否被客户请求。
-
公开(公告)号:US09239852B1
公开(公告)日:2016-01-19
申请号:US13802069
申请日:2013-03-13
Applicant: Amazon Technologies, Inc.
Inventor: David Alan Lutz , Xianglong Huang , Wei Xiao , Stefano Stefani , Timothy Andrew Rath , Somasundaram Perianayagam
CPC classification number: G06F17/30584 , G06F17/3033
Abstract: A distributed database management system comprising a plurality of computing nodes may distribute data evenly across all nodes. A definition of a primary key that divides the primary key into at least a first key portion and a second key portion may be utilized to locate items related by a first key portion to a specific computing node. Application-consistent queries, local transactions and pivoting operations may be performed on items related by a first key portion.
Abstract translation: 包括多个计算节点的分布式数据库管理系统可以在所有节点上均匀分布数据。 将主密钥划分为至少第一密钥部分和第二密钥部分的主密钥的定义可以用于将由第一密钥部分相关的条目定位到特定计算节点。 应用程序一致性查询,本地事务和枢转操作可以在与第一关键部分相关的项目上执行。
-
-
-
-