-
公开(公告)号:US09767112B2
公开(公告)日:2017-09-19
申请号:US15224649
申请日:2016-07-31
Applicant: Splunk Inc.
IPC: G06F17/30
CPC classification number: G06F17/30144 , G06F17/3015 , G06F17/30286
Abstract: Embodiments are directed towards managing and tracking item identification of a plurality of items to determine if an item is a new or existing item, where an existing item has been previously processed. In some embodiments, two or more item identifiers may be generated. In one embodiment, generating the two or more item identifiers may include analyzing the item using a small item size characteristic, a compressed item, or for an identifier collision. The two or more item identifiers may be employed to determine if the item is a new or existing item. In one embodiment, the two or more item identifiers may be compared to a record about an existing item to determine if the item is a new or existing item. If the item is an existing item, then the item may be further processed to determine if the existing item has actually changed.
-
公开(公告)号:US09124612B2
公开(公告)日:2015-09-01
申请号:US14266817
申请日:2014-04-30
Applicant: Splunk Inc.
Inventor: Sundar Rengarajan Vasan , Mitchell Neuman Blank, Jr. , Vishal Patel , Da Xu , Jagannath Kerai
CPC classification number: H04L67/1097 , G06F11/20 , G06F17/30575
Abstract: According to various embodiments, techniques are described for managing data within a multi-site clustered data intake and query system. A data intake and query system as described herein generally refers to a system for collecting, retrieving, and analyzing data. In this context, a clustered data intake and query system generally refers to a system environment that is configured to provide data redundancy and other features that improve the availability of data stored by the system. For example, a clustered data intake and query system may be configured to store multiple copies of data stored by the system across multiple components such that recovery from a failure of one or more of the components is possible by using copies of the data stored elsewhere in the cluster.
Abstract translation: 根据各种实施例,描述了用于管理多站点群集数据访问和查询系统内的数据的技术。 本文所述的数据采集和查询系统通常是指用于收集,检索和分析数据的系统。 在这种情况下,集群数据采集和查询系统通常是指被配置为提供数据冗余和提高系统存储的数据的可用性的其他特征的系统环境。 例如,集群数据采集和查询系统可以被配置为存储由多个组件存储的系统的多个副本,以便可以通过使用其他地方存储的数据的副本来从一个或多个组件的故障中恢复 集群。
-
公开(公告)号:US08788459B2
公开(公告)日:2014-07-22
申请号:US13648116
申请日:2012-10-09
Applicant: Splunk Inc.
Inventor: Vishal Patel , Mitchell Neuman Blank, Jr. , Sundar Rengarajan Vasan , Stephen Phillip Sorkin
IPC: G06F17/30
CPC classification number: H04L67/1097 , G06F11/2097 , G06F17/30312
Abstract: Embodiments are directed towards managing within a cluster environment having a plurality of indexers for data storage using redundancy the data being managed using a generation identifier, such that a primary indexer is designated for a given generation of data. When a master device for the cluster fails, data may continue to be stored using redundancy, and data searches performed may still be performed.
Abstract translation: 实施例旨在在具有多个索引器的集群环境内管理,用于使用生成标识符来管理数据的冗余来进行数据存储,从而为指定的生成数据指定主索引器。 当集群的主设备发生故障时,可以继续使用冗余来存储数据,并且仍然可以执行数据搜索。
-
公开(公告)号:US12061533B1
公开(公告)日:2024-08-13
申请号:US17877725
申请日:2022-07-29
Applicant: Splunk Inc.
Inventor: Amritpal Singh Bath , Samat Jain , Felix Jiang , Shanmugam Kailasam , Jibang Liu , Isabelle Park , Vishal Patel , Divya Vijayan , Jiahan Wang , Tingjin Xu
CPC classification number: G06F11/3476 , G06F3/0619 , G06F2201/81
Abstract: Ingest health monitoring includes receiving an event stream of events in a data intake and query system to store on at least one storage system and obtaining an event from the event stream. Ingest health monitoring further includes transmitting the event to a selected ingest module queue for the event, updating an output rate indicator counter for the selected ingest module queue when failure to store the event in the ingest module queue occurs, obtaining the event from the selected ingest module queue, processing the event to generate a file for the event, and transmitting the file to the at least one storage system. Ingest health monitoring further includes updating the write failure indicator counter for a storage system of the at least one storage system when failure to transmit to the storage system occurs and updating the user interface based on the output rate indicator counter and the write failure indicator counter.
-
公开(公告)号:US11562023B1
公开(公告)日:2023-01-24
申请号:US15967585
申请日:2018-04-30
Applicant: Splunk Inc.
Inventor: Alexandros Batsakis , Sourav Pal , Sai Krishna Sajja , Hasan Alayli , Vishal Patel , Igor Stojanovski , Eric Woo , Steve Wong , Tameem Anwar
IPC: G06F16/901 , G06F3/06 , G06F16/23 , G06F16/27
Abstract: Systems and methods are disclosed for processing and executing queries in a data intake and query system. An indexing system of the data intake and query system receives data and stores at least a portion of it in buckets, which are then stored in a shared storage system. The indexing system merges multiple buckets to generate merged buckets and uploads the merged buckets to the shared storage system.
-
公开(公告)号:US11550829B2
公开(公告)日:2023-01-10
申请号:US16353886
申请日:2019-03-14
Applicant: Splunk Inc
Inventor: Vishal Patel , Jagannath Kerai , Hasan Alayli
Abstract: The present invention is related to a method for providing dynamic indexer discovery. The method comprises receiving, from an index manager, a status indication associated with a plurality of indexers, wherein each of the plurality of indexers indexes events of raw machine-generated data received from a plurality of data collectors. The method further comprises determining a weight associated with each of the plurality of indexers and selecting an indexer from the plurality of indexers. Subsequently, the method comprises allocating data to the indexer in accordance with a respective weight assigned to the indexer and transmitting the allocated data to the indexer.
-
公开(公告)号:US20220398128A1
公开(公告)日:2022-12-15
申请号:US17343508
申请日:2021-06-09
Applicant: Splunk Inc.
Inventor: Manu Jose, JR. , Sanish N. Mahadik , Vishal Patel , Joshua Weinstein
Abstract: A processing node selects a first task from a task list and sends, to a task assignment repository, a first write operation with a first task identifier of the first task to assign the first task to the processing node. The processing node detects failure of the first write operation based on the first task already being assigned and selects a second task from the task list. The processing node sends, to the task assignment repository, a second write operation with a second task identifier of the second task to assign the second task to the processing node. The processing node detects success of the second write operation and executes the second task.
-
公开(公告)号:US11200246B2
公开(公告)日:2021-12-14
申请号:US15339906
申请日:2016-10-31
Applicant: Splunk Inc.
Inventor: Esguerra Ma Kharisma , Igor Stojanovski , Vishal Patel
IPC: G06F16/22 , G06F16/242 , G06F16/2455 , G06F16/2458 , G06F16/248 , G06F16/25 , G06F16/28 , G06F16/835 , G06F16/901 , G06F16/903 , G06F16/9038 , G06F16/951 , G06F16/9535 , G06F3/0481 , G06T11/20 , H04L12/26 , H04L29/08
Abstract: The disclosed embodiments include a method performed by a data intake and query system. The method includes ingesting metrics including respective key values and respective measured values, where the respective key values include a primary key value of a selected primary key. The method further includes generating a hash value for each metric by processing each primary key value with a hashing function, and indexing each metric in association with an existing hash bucket having a matching hash value.
-
公开(公告)号:US10860537B2
公开(公告)日:2020-12-08
申请号:US15663652
申请日:2017-07-28
Applicant: Splunk Inc.
IPC: G06F17/30 , G06F16/17 , G06F16/20 , G06F16/174
Abstract: Embodiments are directed towards managing and tracking item identification of a plurality of items to determine if an item is a new or existing item, where an existing item has been previously processed. In some embodiments, two or more item identifiers may be generated. In one embodiment, generating the two or more item identifiers may include analyzing the item using a small item size characteristic, a compressed item, or for an identifier collision. The two or more item identifiers may be employed to determine if the item is a new or existing item. In one embodiment, the two or more item identifiers may be compared to a record about an existing item to determine if the item is a new or existing item. If the item is an existing item, then the item may be further processed to determine if the existing item has actually changed.
-
公开(公告)号:US10657146B2
公开(公告)日:2020-05-19
申请号:US15339889
申请日:2016-10-31
Applicant: Splunk Inc.
Inventor: Amrittpal Singh Bath , Pratiksha Shah , Murugan Kandaswamy , Vishal Patel
IPC: G06F16/00 , G06F16/248 , G06F16/22 , G06F16/25 , G06F16/28 , G06F16/901 , G06F16/951 , G06F16/242 , G06F16/2455 , G06F16/2458 , G06F16/835 , G06F16/9038 , G06F16/9535 , G06F16/903 , H04L29/08 , G06F3/0481 , G06T11/20 , H04L12/26
Abstract: The disclosed embodiments include a method performed by a data intake and query system. The method includes ingesting data including raw data obtained over a computer network from a plurality of remote computer systems, and generating events, where each event includes a segment of the raw data and a respective timestamp. The method further includes extracting field values from at least a portion of the raw data of the events, where the field values each include a numerical value, and each numerical value is indicative of a measured characteristic of a computing device. The method further includes generating structured metrics, where each structured metric has a respective numerical value, and indexing the plurality of structured metrics.
-
-
-
-
-
-
-
-
-