公开(公告)号：US11663219B1

公开(公告)日：2023-05-30

申请号：US17239384

申请日：2021-04-23

Applicant: Splunk Inc.

Inventor： Dragoljub Profirovic ,  Min Zhang ,  Poornima Devaraj

IPC: G06F16/2455 ,  G06F11/34 ,  G06F16/2457 ,  G06F16/2453

CPC classification number: G06F16/24568 ,  G06F11/3409 ,  G06F16/2453 ,  G06F16/2457

Abstract: Systems and methods are described for tuning parameter values of a processing pipeline in a streaming data processing system. In order to determine an optimal set of parameter values for a particular processing pipeline, a processing pipeline can be implemented with different sets of parameter values. A performance metric can be measured for each implementation to measure the performance of the processing pipeline with regards to a particular set of parameter values. The performance metrics for each implementation can be compared in order to determine optimal performance metrics. The processing pipeline can be implemented based on an optimal set of parameter values that correspond to the optimal performance metrics.

公开(公告)号：US11989592B1

公开(公告)日：2024-05-21

申请号：US17444170

申请日：2021-07-30

Applicant: Splunk Inc.

Inventor： Sanjeev Kulkarni ,  Zhimin Liang ,  Boyang Peng ,  Dragoljub Profirovic

IPC: G06F9/50 ,  H04L9/40

CPC classification number: G06F9/505 ,  G06F9/5061 ,  H04L63/0853

Abstract: Systems and methods are described for implementation by a streaming data processing system of a processing pipeline that obtains data items from one or more data sources. The one or more data sources may include multiple partitions of a topic or multiple topics. The one or more data sources are defined by a data pattern, a group of tenants, or a process. The implementation of the processing pipeline can include identifying the one or more data sources to obtain data items. The processing pipeline can include a plurality of processing tasks to obtain the data items. The streaming data processing system can utilize a workload coordinator to dynamically assign particular data sources to particular processing tasks. The implementation of the processing pipeline can further include executing the plurality of processing tasks to cause processing tasks to obtain data items from assigned data sources and process the data items.