-
公开(公告)号:US10135703B1
公开(公告)日:2018-11-20
申请号:US14858360
申请日:2015-09-18
Applicant: Amazon Technologies, Inc.
Inventor: Aanchal Gupta , Kiran Kumar Muniswamy Reddy , Shirley Xue Yi Ly , Lokendra Singh Panwar , Pejus Manoj Das
Abstract: A data storage system may implement generating creation performance metrics for a secondary index of a table. Metrics may be collected from different partitions of a table and different partitions of a secondary index in a table store upon initiating creation of the secondary index for the table that utilize provisioned resources for creating the secondary index. The metrics may be analyzed to generate performance metrics for the creation of the table. The performance metrics may be provided to clients of the data store or to monitoring systems. Monitoring systems may send performance event notifications to clients or automatically perform modifications to the provisioned throughput capacity.
-
公开(公告)号:US10102230B1
公开(公告)日:2018-10-16
申请号:US14859069
申请日:2015-09-18
Applicant: Amazon Technologies, Inc.
Inventor: Kiran Kumar Muniswamy Reddy , Wei Xiao , Pejus Manoj Das , Lokendra Singh Panwar , Xianglong Huang
Abstract: A data storage system may implement rate-limiting secondary index creation for an online table. A secondary index may be generated for a table stored in a data store. The table may be incrementally indexed, maintaining the updates determined according to indexing different portions of the table in a queue of pending updates that are subsequently applied at the secondary index. Prior to indexing a portion of the table, an evaluation of a current number of pending updates in the queue of pending updates may be performed with respect to a throttle threshold. If the current number of pending updates exceeds the throttle threshold, then indexing the portion of the table may be throttled. Received updates to previously indexed portions of the table, may be applied to the table and placed in the queue of pending updates without an evaluation of the current number of pending requests.
-
3.
公开(公告)号:US10013449B1
公开(公告)日:2018-07-03
申请号:US14859062
申请日:2015-09-18
Applicant: Amazon Technologies, Inc.
Inventor: Wei Xiao , Kiran Kumar Muniswamy Reddy , Pejus Manoj Das , Adam Douglas Morley , Shirley Xue Yi Ly
IPC: G06F17/30
CPC classification number: G06F16/2365 , G06F16/22
Abstract: A non-relational data store may implement validating and non-validating secondary indexes for a table. Operations at a table for a given item may be performed when indexing the item to create a secondary index or when updates to the given item are received. Attribute values of a given item may be validated with respect to an indexing schema for the secondary index. For a non-validating secondary index, validation errors detected for the attribute values may be ignored so that the operation at the table may be performed. For a validating secondary index, validation errors detected for the attribute values may result in denying performance of the operation. In some embodiments, a secondary index from may be changed from validating to non-validating, or non-validating to validating.
-
公开(公告)号:US09875270B1
公开(公告)日:2018-01-23
申请号:US14859053
申请日:2015-09-18
Applicant: Amazon Technologies, Inc.
Inventor: Kiran Kumar Muniswamy Reddy , Wei Xiao , Pejus Manoj Das , Xianglong Huang , Nirmal Mehta
IPC: G06F17/30
CPC classification number: G06F17/30362 , G06F17/30321 , G06F17/30345 , G06F17/30589
Abstract: A data storage system may implement locking item ranges for creating a secondary index of an online table. A secondary index may be generated for a table of items stored in a non-relational data store. Different ranges of items in the data store may be locked while a corresponding portion of the secondary index is generated. Upon generating the corresponding portion of the secondary index, a range of items may be unlocked. While generating the secondary index, the table may be made available for servicing access requests. For a request to update the table received during the generation of the secondary index, a determination may be made as to whether the update is included within a locked range of the table. If locked, the request may be delayed until the range is unlocked.
-
公开(公告)号:US10853129B1
公开(公告)日:2020-12-01
申请号:US16358355
申请日:2019-03-19
Applicant: Amazon Technologies, Inc.
Inventor: Sudipta Sengupta , Haifeng He , Pejus Manoj Das , Poorna Chand Srinivas Perumalla , Wei Xiao , Shirley Xue Yi Leung , Vladimir Mitrovic , Yongcong Luo , Jiacheng Guo , Stefano Stefani , Matthew Shawn Wilson
Abstract: Implementations detailed herein include description of a computer-implemented method to migrate a machine learning model from one accelerator portion (such as a portion of a graphical processor unit (GPU)) to a different accelerator portion. In some instances, a state of the first accelerator portion is persisted, the second accelerator portion is configured, the first accelerator portion is then detached from a client application instance, and at least a portion of an inference request is performed using the loaded at least a portion of the machine learning model on the second accelerator portion that had been configured.
-
公开(公告)号:US10715479B2
公开(公告)日:2020-07-14
申请号:US15250440
申请日:2016-08-29
Applicant: Amazon Technologies, Inc.
Inventor: Pejus Manoj Das , David Craig Yanacek
Abstract: Methods and apparatus for connection redistribution in load-balanced systems that include multiple load balancers each serving multiple nodes. In the connection redistribution method, each node estimates a connection close rate, which may be based on an estimation of the percentage of the overall client traffic received by the respective load balancer that is being handled by the node. The node generates close requests for connections between the respective load balancer and clients according to the connection close rate. The node sends the close requests to its load balancer, which forwards the close requests to the appropriate clients. Upon receiving a close request, a client may close the connection(s) indicated by the request, obtain a public IP address for a load balancer, and initiate new connection(s) to the respective load balancer via the public IP address.
-
公开(公告)号:US09432305B1
公开(公告)日:2016-08-30
申请号:US13927851
申请日:2013-06-26
Applicant: Amazon Technologies, Inc.
Inventor: Pejus Manoj Das , David Craig Yanacek
IPC: G06F15/16 , H04L12/923
CPC classification number: H04L61/1511 , H04L61/2007 , H04L67/02 , H04L67/1002 , H04L67/1008 , H04L67/143 , H04L69/16
Abstract: Methods and apparatus for connection redistribution in load-balanced systems that include multiple load balancers each serving multiple nodes. In the connection redistribution method, each node estimates a connection close rate, which may be based on an estimation of the percentage of the overall client traffic received by the respective load balancer that is being handled by the node. The node generates close requests for connections between the respective load balancer and clients according to the connection close rate. The node sends the close requests to its load balancer, which forwards the close requests to the appropriate clients. Upon receiving a close request, a client may close the connection(s) indicated by the request, obtain a public IP address for a load balancer, and initiate new connection(s) to the respective load balancer via the public IP address.
Abstract translation: 负载平衡系统中连接重新分配的方法和装置,其中包括多个负载平衡器,每个负载平衡器都为多个节点提供服务。 在连接再分配方法中,每个节点估计连接关闭速率,其可以基于由节点正在处理的相应负载平衡器接收的总体客户端流量的百分比的估计。 该节点根据连接关闭速率生成关于相应负载平衡器和客户端之间的连接的紧密请求。 该节点向其负载均衡器发送关闭请求,该负载平衡器将关闭请求转发给适当的客户端。 在收到紧密请求后,客户端可以关闭由请求指示的连接,获取负载平衡器的公共IP地址,并通过公共IP地址向各个负载均衡器发起新的连接。
-
公开(公告)号:US09128965B1
公开(公告)日:2015-09-08
申请号:US13961778
申请日:2013-08-07
Applicant: Amazon Technologies, Inc.
Inventor: David Craig Yanacek , Mohammad Zeeshan Qureshi , Jai Vasanth , Pejus Manoj Das , Stefano Stefani , Stuart Henry Seelye Marshall , Wei Xiao
IPC: G06F17/30
CPC classification number: G06F17/30297 , G06F17/30292 , G06F17/30339 , G06F17/30876
Abstract: Methods and apparatus for configurable-capacity time-series tables are disclosed. A schedule of database table management operations, including at least an operation to change a throughput constraint associated with a table in response to a triggering event, is generated. The table is instantiated with an initial throughput constraint in accordance with the schedule. Work requests directed to the table are accepted based on the initial throughput constraint. The throughput constraint is modified in response to the triggering event. Subsequent work requests are accepted based on the modified throughput constraint.
Abstract translation: 公开了可配置容量时间序列表的方法和装置。 生成数据库表管理操作的调度表,其包括响应于触发事件而至少改变与表关联的吞吐量约束的操作。 该表根据时间表以初始吞吐量约束进行实例化。 基于初始吞吐量约束接受指向表的工作请求。 响应于触发事件修改吞吐量约束。 基于修改的吞吐量约束接受后续工作请求。
-
公开(公告)号:US11327937B1
公开(公告)日:2022-05-10
申请号:US14859059
申请日:2015-09-18
Applicant: Amazon Technologies, Inc.
Inventor: Kiran Kumar Muniswamy Reddy , Yijun Lu , Wei Xiao , Pejus Manoj Das , Shirley Xue Yi Ly , Aanchal Gupta
IPC: G06F16/22 , G06F16/27 , G06F16/28 , G06F16/2457 , G06F16/24
Abstract: A distributed data storage system may implement determining indexing progress for a table stored in the distributed data storage system. A table may be stored in multiple table partitions. When a secondary index is created for the table, each partition may independently index the items stored within the table partition in order to identify those items in the partition that should be stored in the secondary index. During creation of the secondary index, creation progress points that indicate the progress of the indexing across the table partitions may be determined. The creation progress points may be provided via a programmatic, textual, or graphical interface to the distributed data storage system.
-
公开(公告)号:US10922303B1
公开(公告)日:2021-02-16
申请号:US15680128
申请日:2017-08-17
Applicant: Amazon Technologies, Inc.
Inventor: Lewis Bruck , Pejus Manoj Das , Dumanshu Goyal , Chase Kernan , Akshat Vig
Abstract: A system that implements a data storage system may store data for a database table in multiple replicated partitions on respective storage nodes. An export of an active database partition may generate an exported copy of the database partition. A first exported copy may be stored locally on a source node and a second exported copy of the database partition may be sent to a recipient node. The source node may validate the first copy responsive to sending the second copy and may perform the validation while the second copy is being sent and processed at the recipient node. If the first copy cannot be validated, the source node may cause the second copy to be invalidated and abort further processing of the second copy. The source node may also cause the second copy to be marked as invalid to prevent reliance on an invalid database partition copy.
-
-
-
-
-
-
-
-
-