Invention Grant
- Patent Title: Dynamic partitioning techniques for data streams
-
Application No.: US15665103Application Date: 2017-07-31
-
Publication No.: US10691716B2Publication Date: 2020-06-23
- Inventor: Marvin Michael Theimer , Gaurav D. Ghare , John David Dunagan , Gregory M. Burgess , Ying Xiong
- Applicant: Amazon Technologies, Inc.
- Applicant Address: US WA Seattle
- Assignee: Amazon Technologies, Inc.
- Current Assignee: Amazon Technologies, Inc.
- Current Assignee Address: US WA Seattle
- Agency: Kowert, Hood, Munyon, Rankin & Goetzel, P.C.
- Agent Robert C. Kowert
- Main IPC: G06F16/25
- IPC: G06F16/25 ; G06F16/00

Abstract:
A partitioning policy, comprising an indication of an initial mapping of data records of a stream to a plurality of partitions, is selected to distribute data records of a data stream among a plurality of nodes of a stream management service. Data ingestion nodes and storage nodes are configured according to the initial mapping. In response to a determination that a triggering criterion for dynamically repartitioning the data stream has been met, a modified mapping is generated, and a different set of ingestion and storage nodes are configured. For at least some time during which arriving data records are stored in accordance with the modified mapping, data records stored at the first set of storage nodes in accordance with the initial mapping are retained.
Public/Granted literature
- US20170357703A1 DYNAMIC PARTITIONING TECHNIQUES FOR DATA STREAMS Public/Granted day:2017-12-14
Information query