-
公开(公告)号：US11095522B2
公开(公告)日：2021-08-17
申请号：US16547399
申请日：2019-08-21
摘要： Described herein is a system and method for dynamically scaling a stream processing system (e.g., “exactly once” data stream processing system). Various parameter(s) (e.g., user-configurable capacity, real-time load metrics, and/or performance counters) can be used to dynamically scale in and/or scale out the “exactly once” stream processing system without system restart. Delay introduced by this scaling operation can be minimized by utilizing a combination of mutable process topology (which can dynamically assign certain parts of the system to a new host machine) and controllable streaming processor movement with checkpoints and the streaming protocol controlled recovery which still enforces the “exactly once” delivery metric.
-
公开(公告)号：US10733191B2
公开(公告)日：2020-08-04
申请号：US16145337
申请日：2018-09-28
IPC分类号： G06F16/2455 , H04L29/06 , G06F16/901 , H04L1/00 , H04L12/801 , H04L12/40 , H04L29/08
摘要： Described herein is a system and method for a static streaming job startup sequence. During compilation of a streaming job, a graph of computing nodes of the streaming job is traversed to determine a minimum start time of computing node(s) downstream of each input computing node of the streaming job. Also, during compilation, a start time is assigned to each input computing node in accordance with the determined minimum start time. During execution of the streaming job, responsive to receipt of the trigger anchor by a particular input node, processing of the particular input computing node using the determined minimum start time is commenced. The input computing node further generates an anchor. Input data is received, and, a batch of data provided in accordance with the received input data and generated anchor.
-
搜索结果
2 条记录 (耗时 0.012 秒)
