Dynamic storage and deferred analysis of data stream events

    公开(公告)号:US11789950B1

    公开(公告)日:2023-10-17

    申请号:US17074445

    申请日:2020-10-19

    Applicant: Splunk Inc.

    CPC classification number: G06F16/24568 G06F16/22 G06F16/254

    Abstract: Systems and methods are described for a streaming data processing system that defers processing of some data based on a determined importance of the data. A streaming data processing system can ingest a data stream that contains multiple events, and can extract data field values from individual events and process the data field values to determine event importance. The streaming data processing system can then do further processing and indexing of high importance events, and can generate a storage prefix for each low importance event that determines where to store the low importance event in a data storage system. The streaming data processing system can then process queries by retrieving the indexed high importance events, and can extract the data field values from a high importance event to determine the storage prefix for retrieving corresponding low importance events from the data storage system.

Patent Agency Ranking