Implementation of a data processing pipeline using assignable resources and pre-configured resources

    公开(公告)号:US12242892B1

    公开(公告)日:2025-03-04

    申请号:US17444157

    申请日:2021-07-30

    Applicant: Splunk Inc.

    Inventor: Ricky Burnett

    Abstract: Systems and methods are described for a implementing a streaming data processing system that includes a pool of pre-configured resources and a pool of dedicated resources. The streaming data processing system can implement a processing pipeline using compute resources. The pool of pre-configured resources can support previews of processing pipelines for a plurality of users and the pool of dedicated resources can support full deployments of processing pipelines for a particular user. The streaming data processing system can implement a preview of a processing pipeline using a pre-configured resource of the pool of pre-configured resources. Further, the streaming data processing system can implement the processing pipeline using a dedicated resource of the pool of dedicated resources. The streaming data processing system can provision the dedicated resource and deploy the processing pipeline using the dedicated resource.

    DYNAMIC DATA ENRICHMENT
    3.
    发明申请

    公开(公告)号:US20220121708A1

    公开(公告)日:2022-04-21

    申请号:US17072964

    申请日:2020-10-16

    Applicant: SPLUNK INC.

    Abstract: Systems and methods are described for performing dynamic data enrichment in accordance with data streaming. In this regard, dynamic data enrichment can be performed to process data later ingested into an indexing system. In performing dynamic data enrichment, a message can be obtained via a data stream. The message is analyzed to identify a data portion within the message to add to a lookup table. Thereafter, the data portion is written to the lookup table to enhance the lookup table with data from the message. The enhanced lookup table can then be used to lookup a data value to append to the message to enrich the message, and the enriched message can be output (e.g., to an indexing system).

Patent Agency Ranking