-
公开(公告)号:US20230239345A1
公开(公告)日:2023-07-27
申请号:US18194583
申请日:2023-03-31
Applicant: Amazon Technologies, Inc.
Inventor: Benjamin Warren Mercier , Sayantan Chakravorty , Yasemin Avcular , Charlie Paucard
IPC: H04L67/1029 , G06F16/28
CPC classification number: H04L67/1029 , G06F16/285
Abstract: In response to a first programmatic request, metadata indicating that a first isolated read channel of a real-time category has been associated with a first target stream is stored at a stream management service. In response to another request, metadata indicating that a second isolated read channel of a non-real-time category has been associated with a second target stream is stored. In response to a read request indicating the first channel or the second channel, one or more data records of the corresponding target streams are provided.
-
公开(公告)号:US10467105B2
公开(公告)日:2019-11-05
申请号:US15583823
申请日:2017-05-01
Applicant: Amazon Technologies, Inc.
Inventor: Marvin Michael Theimer , Benjamin Warren Mercier , Nathaniel Martin Glass , Gaurav D. Ghare
Abstract: A replication chain comprising one or more replication nodes of a multi-tenant stream management system is assigned to store data records of a partition of a particular data stream. A data record of the partition is received at a selected replication node of the replication chain. In a sequential order, a respective replica of the data record is stored at each replication node of the chain. An acknowledgement of a successful storage of the data record is provided after the replications are completed.
-
公开(公告)号:US10423459B1
公开(公告)日:2019-09-24
申请号:US15275302
申请日:2016-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Richard Jacques de Kadt , Benjamin Warren Mercier , Carlos Vara Callau , Timothy Daniel Cole , Aaron Gifford Freshwater , Sayantan Chakravorty , Allan Henry Vermeulen
Abstract: A resource manager arranges the resources in a computer system into one or more resource pools. The resource manager allocates a number of active resources and a number of backup resources to a particular resource pool. For each resource managed by the resource manager, the resource manager acquires information that describes the capacity and reliability of the resource. Capacity and reliability information for the particular resource pool is determined based on the capacity and reliability information associated with the resources assigned to the pool. In response to a request, the resource manager may provide an application with resources from several resource pools. The likelihood that the resource manager will be able to provide sufficient resources to the application may be determined based at least in part on the reliability information associated with the several resource pools.
-
公开(公告)号:US10346366B1
公开(公告)日:2019-07-09
申请号:US15275307
申请日:2016-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Richard Jacques de Kadt , Benjamin Warren Mercier , Carlos Vara Callau , Timothy Daniel Cole , Aaron Gifford Freshwater , Sayantan Chakravorty , Allan Henry Vermeulen
Abstract: A pipeline management service improves the operation of a processing pipeline by monitoring the operation of one or more journal services within the processing pipeline, and adjusting operational parameters of the one or more journal services. In various examples, the pipeline management service determines a model of the processing pipeline by identifying the producers and consumers associated with each of the one or more journal services, and determines a processing flow through the one or more journal services based at least in part on the identities of the associated producers and consumers. The pipeline management service acquires backlog information from each of the one or more journal services, and may adjust the operational parameters of a journal service associated with an identified processing bottleneck. In some examples, the pipeline management service adjusts capacity and reliability parameters of the one or more journal services to improve the operation of the processing pipeline.
-
5.
公开(公告)号:US11075984B1
公开(公告)日:2021-07-27
申请号:US16143245
申请日:2018-09-26
Applicant: Amazon Technologies, Inc.
Inventor: Benjamin Warren Mercier , Sayantan Chakravorty , Yasemin Avcular
Abstract: At a platform at which stream data retrieval requests directed to a stream management service are processed, respective metrics of reads being performed using a first set of one or more persistent network connections established between the platform and one or more stream processing applications are collected. A request to read additional stream data requests is directed to the platform based at least in part on a decision made by a load balancer. The request is rejected based on a determination that the collected metrics satisfy a threshold.
-
公开(公告)号:US20210021653A1
公开(公告)日:2021-01-21
申请号:US17062435
申请日:2020-10-02
Applicant: Amazon Technologies, Inc.
Inventor: Benjamin Warren Mercier , Sayantan Chakravorty , Yasemin Avcular , Charlie Paucard
IPC: H04L29/06
Abstract: From a stream management service, indications of transmissions of data records of a first data stream via a persistent network connection associated with a subscription are provided to a stream processing application. In response to detecting that a transfer throttling condition associated with the subscription has been met, a delay is introduced before additional data records are transmitted via the same persistent network connection. After a subscription expiration period has elapsed, an indication of the expiration is provided to the application via the persistent connection.
-
公开(公告)号:US10666569B1
公开(公告)日:2020-05-26
申请号:US15275296
申请日:2016-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Richard Jacques de Kadt , Benjamin Warren Mercier , Carlos Vara Callau , Timothy Daniel Cole , Aaron Gifford Freshwater , Sayantan Chakravorty , Allan Henry Vermeulen
IPC: G06F11/14 , G06F16/18 , G06F16/23 , H04L12/911 , H04L29/08
Abstract: A journal service manages a journal that holds a number of journal entries. Journal entries are provided to the journal service by one or more producer services, and the journal service provides journal entries to one or more consumer services. Lead consumers retrieve journal entries from the journal service by specifying a named cursor which identifies a location within the journal from which the journal entries are retrieved. The journal service may select a lead producer and a lead consumer from a collection of candidate producers and consumers using a fitness score determined for each candidate producer and consumer. The fitness score may be based at least in part on the processing capability, predicted reliability, and cost of each candidate producer and consumer. The journal service may replace a lead consumer or producer with an alternate consumer or producer in response to a variety of events.
-
公开(公告)号:US09973306B2
公开(公告)日:2018-05-15
申请号:US14853884
申请日:2015-09-14
Applicant: Amazon Technologies, Inc.
CPC classification number: H04L1/1887 , H04L1/1877 , H04L41/069
Abstract: Methods, systems, and computer-readable media for implementing freshness-sensitive message delivery are disclosed. A stream of events including an earlier event and a later event is received. A first attempt is performed to deliver a message indicative of the earlier event. The first attempt to deliver the message is unsuccessful. One or more additional attempts are scheduled to deliver the message indicative of the earlier event. The additional attempts are scheduled over a period of time following the first attempt. An attempt is performed to deliver an additional message indicative of the later event. The attempt to deliver the additional message is not delayed by the additional attempts to deliver the message.
-
公开(公告)号:US11509700B2
公开(公告)日:2022-11-22
申请号:US17062435
申请日:2020-10-02
Applicant: Amazon Technologies, Inc.
Inventor: Benjamin Warren Mercier , Sayantan Chakravorty , Yasemin Avcular , Charlie Paucard
IPC: H04L65/61 , G06F3/06 , H04L67/02 , H04L67/1097 , H04L65/612 , H04L65/75 , H04L65/80 , H04L67/1095 , H04L67/55
Abstract: From a stream management service, indications of transmissions of data records of a first data stream via a persistent network connection associated with a subscription are provided to a stream processing application. In response to detecting that a transfer throttling condition associated with the subscription has been met, a delay is introduced before additional data records are transmitted via the same persistent network connection. After a subscription expiration period has elapsed, an indication of the expiration is provided to the application via the persistent connection.
-
公开(公告)号:US11070645B1
公开(公告)日:2021-07-20
申请号:US16221032
申请日:2018-12-14
Applicant: Amazon Technologies, Inc.
Inventor: Benjamin Warren Mercier , Thomas Bradley Scholl , Douglas Brian Terry , Craig Wesley Howard
IPC: H04L29/08 , H04L29/06 , H04L12/727 , H04L12/725 , H04L12/729
Abstract: A data delivery service of a service provider may receive respective job specifications for different data transfer jobs between computing infrastructure collections (e.g., data centers). A job specification for a data transfer job may include an amount of data to be transferred for the data transfer job, one or more destinations of data transfers for the data transfer job, and/or one or more flexibility parameters for successful transfer of the data for the data transfer job (e.g., a deadline to transfer the data, available data delivery techniques). The data delivery service may determine a schedule for performing different data transfer jobs between two or more infrastructures based on an analysis of the amount of data to be transferred for each job, the destinations of the data transfer for each job, the flexibility parameters for each job (e.g., included in the respective job specifications), and the connectivity between computing infrastructure collections.
-
-
-
-
-
-
-
-
-