ROUTING DATA BETWEEN PROCESSING PIPELINES VIA A USER DEFINED DATA STREAM

    公开(公告)号:US20220245156A1

    公开(公告)日:2022-08-04

    申请号:US17243209

    申请日:2021-04-28

    Applicant: SPLUNK Inc.

    Abstract: Systems and methods are described for customizable data streams in a streaming data processing system. Routing criteria for the customizable data streams are defined by a user, an automated process, or any other process. The routing criteria can be defined using graphical controls. The streaming data processing system uses the routing criteria to determine data that should be used to populate a particular data stream. Further, processing pipelines are customized such that a particular processing pipeline can obtain data from a particular user defined data stream and write data to a particular user defined data stream. Data is routed through the user defined data streams and customized processing pipelines based on a data route. A data route for a set of data may include multiple user defined data streams and multiple processing pipelines. The data route can include a loop of processing pipelines and data streams.

    STREAMING SYNTHESIS OF DISTRIBUTED TRACES FROM MACHINE LOGS

    公开(公告)号:US20220121628A1

    公开(公告)日:2022-04-21

    申请号:US17074426

    申请日:2020-10-19

    Applicant: Splunk Inc.

    Abstract: Systems and methods are described herein for synthesizing traces from logs of a distributed computing system. A trace represents a single transaction, such as handling of a user request, on the distributed computing system. The transaction can include multiple underlying operations on the distributed computing system, which are represented as spans within the trace and may be hierarchically arranged within the trace. In instances where a distributed computing system does not provide for tracing natively, a trace can be synthesized from log entries of the distributed computing system. A streaming data processing system can ingest a data stream including log entries, and identify within the data stream those log entries relating to a given transaction. The streaming data processing system can further identify log entries that demark the beginnings and endings of operations for that transaction, and can utilize the identified log entries to build a trace for the transaction.

    Dynamic storage and deferred analysis of data stream events

    公开(公告)号:US11789950B1

    公开(公告)日:2023-10-17

    申请号:US17074445

    申请日:2020-10-19

    Applicant: Splunk Inc.

    CPC classification number: G06F16/24568 G06F16/22 G06F16/254

    Abstract: Systems and methods are described for a streaming data processing system that defers processing of some data based on a determined importance of the data. A streaming data processing system can ingest a data stream that contains multiple events, and can extract data field values from individual events and process the data field values to determine event importance. The streaming data processing system can then do further processing and indexing of high importance events, and can generate a storage prefix for each low importance event that determines where to store the low importance event in a data storage system. The streaming data processing system can then process queries by retrieving the indexed high importance events, and can extract the data field values from a high importance event to determine the storage prefix for retrieving corresponding low importance events from the data storage system.

    Determining a set of parameter values for a processing pipeline

    公开(公告)号:US11663219B1

    公开(公告)日:2023-05-30

    申请号:US17239384

    申请日:2021-04-23

    Applicant: Splunk Inc.

    CPC classification number: G06F16/24568 G06F11/3409 G06F16/2453 G06F16/2457

    Abstract: Systems and methods are described for tuning parameter values of a processing pipeline in a streaming data processing system. In order to determine an optimal set of parameter values for a particular processing pipeline, a processing pipeline can be implemented with different sets of parameter values. A performance metric can be measured for each implementation to measure the performance of the processing pipeline with regards to a particular set of parameter values. The performance metrics for each implementation can be compared in order to determine optimal performance metrics. The processing pipeline can be implemented based on an optimal set of parameter values that correspond to the optimal performance metrics.

    User interface for customizing data streams and processing pipelines

    公开(公告)号:US12164524B2

    公开(公告)日:2024-12-10

    申请号:US18304770

    申请日:2023-04-21

    Applicant: Splunk Inc.

    Abstract: Systems and methods are described for customizable data streams in a streaming data processing system. Routing criteria for the customizable data streams are defined by a user, an automated process, or any other process. The routing criteria can be defined using graphical controls. The streaming data processing system uses the routing criteria to determine data that should be used to populate a particular data stream. Further, processing pipelines are customized such that a particular processing pipeline can obtain data from a particular user defined data stream and write data to a particular user defined data stream. Data is routed through the user defined data streams and customized processing pipelines based on a data route. A data route for a set of data may include multiple user defined data streams and multiple processing pipelines. The data route can include a loop of processing pipelines and data streams.

    User interface for customizing data streams

    公开(公告)号:US11636116B2

    公开(公告)日:2023-04-25

    申请号:US17243156

    申请日:2021-04-28

    Applicant: SPLUNK Inc.

    Abstract: Systems and methods are described for customizable data streams in a streaming data processing system. Routing criteria for the customizable data streams are defined by a user, an automated process, or any other process. The routing criteria can be defined using graphical controls. The streaming data processing system uses the routing criteria to determine data that should be used to populate a particular data stream. Further, processing pipelines are customized such that a particular processing pipeline can obtain data from a particular user defined data stream and write data to a particular user defined data stream. Data is routed through the user defined data streams and customized processing pipelines based on a data route. A data route for a set of data may include multiple user defined data streams and multiple processing pipelines. The data route can include a loop of processing pipelines and data streams.

    USER DEFINED DATA STREAM FOR ROUTING DATA

    公开(公告)号:US20220247695A1

    公开(公告)日:2022-08-04

    申请号:US17243128

    申请日:2021-04-28

    Applicant: SPLUNK Inc.

    Abstract: Systems and methods are described for customizable data streams in a streaming data processing system. Routing criteria for the customizable data streams are defined by a user, an automated process, or any other process. The routing criteria can be defined using graphical controls. The streaming data processing system uses the routing criteria to determine data that should be used to populate a particular data stream. Further, processing pipelines are customized such that a particular processing pipeline can obtain data from a particular user defined data stream and write data to a particular user defined data stream. Data is routed through the user defined data streams and customized processing pipelines based on a data route. A data route for a set of data may include multiple user defined data streams and multiple processing pipelines. The data route can include a loop of processing pipelines and data streams.

Patent Agency Ranking