Distributed dynamic processing method for stream data within a computer system

    公开(公告)号:US10719370B2

    公开(公告)日:2020-07-21

    申请号:US16180460

    申请日:2018-11-05

    Abstract: The present invention involves with a dynamic distributed processing method for stream data, at least comprising: analyzing and predicting an execution mode of at least one data feature block of the data of a user stream data processing program; dynamically adjusting the execution mode based on an average magnitude of queue latency and a threshold of queue latency of the stream data; and processing corresponding said at least one data feature block based on the execution mode. By associating and combining the irrelevant data stream mode and micro-batch mode of stream data computing, the present invention successfully releases automatic shift and data process between the two modes, which advantageously has both the high throughput property and the low latency property.

    DISTRIBUTED DYNAMIC PROCESSING METHOD FOR STREAM DATA WITHIN A COMPUTER SYSTEM

    公开(公告)号:US20190205179A1

    公开(公告)日:2019-07-04

    申请号:US16180460

    申请日:2018-11-05

    Abstract: The present invention involves with a dynamic distributed processing method for stream data, at least comprising: analyzing and predicting an execution mode of at least one data feature block of the data of a user stream data processing program; dynamically adjusting the execution mode based on an average magnitude of queue latency and a threshold of queue latency of the stream data; and processing corresponding said at least one data feature block based on the execution mode. By associating and combining the irrelevant data stream mode and micro-batch mode of stream data computing, the present invention successfully releases automatic shift and data process between the two modes, which advantageously has both the high throughput property and the low latency property.

Patent Agency Ranking