Monitoring changes to data items using associated metadata

    公开(公告)号:US11580071B2

    公开(公告)日:2023-02-14

    申请号:US17080416

    申请日:2020-10-26

    Applicant: SPLUNK INC.

    Abstract: Embodiments are directed towards managing and tracking item identification of a plurality of items to determine if an item is a new or existing item, where an existing item has been previously processed. In some embodiments, two or more item identifiers may be generated. In one embodiment, generating the two or more item identifiers may include analyzing the item using a small item size characteristic, a compressed item, or for an identifier collision. The two or more item identifiers may be employed to determine if the item is a new or existing item. In one embodiment, the two or more item identifiers may be compared to a record about an existing item to determine if the item is a new or existing item. If the item is an existing item, then the item may be further processed to determine if the existing item has actually changed.

    MONITORING CHANGES TO DATA ITEMS USING ASSOCIATED METADATA

    公开(公告)号:US20210042269A1

    公开(公告)日:2021-02-11

    申请号:US17080416

    申请日:2020-10-26

    Applicant: SPLUNK INC.

    Abstract: Embodiments are directed towards managing and tracking item identification of a plurality of items to determine if an item is a new or existing item, where an existing item has been previously processed. In some embodiments, two or more item identifiers may be generated. In one embodiment, generating the two or more item identifiers may include analyzing the item using a small item size characteristic, a compressed item, or for an identifier collision. The two or more item identifiers may be employed to determine if the item is a new or existing item. In one embodiment, the two or more item identifiers may be compared to a record about an existing item to determine if the item is a new or existing item. If the item is an existing item, then the item may be further processed to determine if the existing item has actually changed.

    Computing and replicating event deltas for mutable events in a distributed system

    公开(公告)号:US10891284B2

    公开(公告)日:2021-01-12

    申请号:US15582458

    申请日:2017-04-28

    Applicant: SPLUNK INC.

    Abstract: The present disclosure provides solutions for determining the divergence (delta) between the current and previous reference data structures for mutable data in a search head. A method is provided that includes updating a pre-existing lookup table in a search head, generating a delta file that identifies the divergence between the updated and previous lookup table, and distributing the delta file to other components in the search environment. The compatibility of the delta file is checked with the local instance of the lookup table in each search component, and the lookup table is applied if compatibility is determined. However, if the delta file is determined to not be compatible with the current version of a local lookup table in an indexer, the entire lookup table sent to the requesting indexer instead.

    COMPUTING AND REPLICATING EVENT DELTAS FOR MUTABLE EVENTS IN A DISTRIBUTED SYSTEM

    公开(公告)号:US20180314726A1

    公开(公告)日:2018-11-01

    申请号:US15582458

    申请日:2017-04-28

    Applicant: SPLUNK INC.

    Abstract: The present disclosure provides solutions for determining the divergence (delta) between the current and previous reference data structures for mutable data in a search head. A method is provided that includes updating a pre-existing lookup table in a search head, generating a delta file that identifies the divergence between the updated and previous lookup table, and distributing the delta file to other components in the search environment. The compatibility of the delta file is checked with the local instance of the lookup table in each search component, and the lookup table is applied if compatibility is determined. However, if the delta file is determined to not be compatible with the current version of a local lookup table in an indexer, the entire lookup table sent to the requesting indexer instead.

    Adaptive monitoring and processing of new data files and changes to existing data files

    公开(公告)号:US10083190B2

    公开(公告)日:2018-09-25

    申请号:US14014059

    申请日:2013-08-29

    Applicant: Splunk Inc.

    CPC classification number: G06F16/21 G06F16/1734

    Abstract: Embodiments are directed towards a dynamic change evaluation mechanism, whereby items having a detected possible change are scheduled for re-evaluation for possible changes at a higher frequency than items detected to not have previously changed, while those items detected as not to have changed are dynamically scheduled for re-evaluation based on an evaluation backlog that may be in turn based, in part, on a time from when an item is assigned an expiration time to when the item is evaluated. In one embodiment, a possibly changed item may be assigned a new expiration time independent of the evaluation backlog. In another embodiment, if no change is detected, then the item may be assigned a new expiration time as a function of a previous expiration time and on the evaluation backlog.

    File update detection and processing

    公开(公告)号:US09767112B2

    公开(公告)日:2017-09-19

    申请号:US15224649

    申请日:2016-07-31

    Applicant: Splunk Inc.

    CPC classification number: G06F17/30144 G06F17/3015 G06F17/30286

    Abstract: Embodiments are directed towards managing and tracking item identification of a plurality of items to determine if an item is a new or existing item, where an existing item has been previously processed. In some embodiments, two or more item identifiers may be generated. In one embodiment, generating the two or more item identifiers may include analyzing the item using a small item size characteristic, a compressed item, or for an identifier collision. The two or more item identifiers may be employed to determine if the item is a new or existing item. In one embodiment, the two or more item identifiers may be compared to a record about an existing item to determine if the item is a new or existing item. If the item is an existing item, then the item may be further processed to determine if the existing item has actually changed.

    Implementing a split-brain prevention strategy when configuring automatic cluster manager failover

    公开(公告)号:US12265858B1

    公开(公告)日:2025-04-01

    申请号:US17827563

    申请日:2022-05-27

    Applicant: Splunk Inc.

    Abstract: A method of dynamic cluster manager failover includes routing data traffic associated with managing a plurality of indexers in a cluster to a first cluster manager, wherein the first cluster manager is associated with an active role and is operable to manage the plurality of indexers in the cluster. The method also includes transmitting periodic heartbeat request messages from a second cluster manager of the cluster to the first cluster manager, wherein the second cluster manager is associated with a standby role. Further, the method includes detecting, at the second cluster manager, a loss of heartbeat response messages from the first cluster manager. Also, the method includes receiving information from a set of indexers regarding a status of the first cluster manager and in response to a determination that the status of the first cluster manager is offline, promoting the second cluster manager to switch over to the active role.

    Failover cluster management using a semi-bidirectional heartbeat mechanism

    公开(公告)号:US12141040B1

    公开(公告)日:2024-11-12

    申请号:US17827526

    申请日:2022-05-27

    Applicant: Splunk Inc.

    Abstract: A computer-implemented method of providing for dynamic cluster manager failover includes routing data traffic associated with managing network components in a cluster to an active cluster manager, where the active cluster manager manages a plurality of network components in the cluster. The method also includes transmitting periodic heartbeat request messages from a standby cluster manager to the active cluster manager. Further, the method includes detecting a loss of heartbeat response messages from the active cluster manager, where the heartbeat response messages are transmitted from the standby cluster manager to the active cluster manager in response to the periodic heartbeat request messages. The method also includes promoting the standby cluster manager to an active role and re-routing the data traffic associated with managing the network components to the currently active cluster manager.

Patent Agency Ranking