-
公开(公告)号:US20190147085A1
公开(公告)日:2019-05-16
申请号:US16146990
申请日:2018-09-28
Applicant: Splunk Inc.
Inventor: Sourav Pal , Arindam Bhattacharjee
IPC: G06F17/30
Abstract: Systems and methods are disclosed for receiving, at a data intake and query system, a query that includes a subquery that is to be executed at an external data system that supports a different query language than the data intake and query system. The data intake and query system converts the subquery from the query language supported by the external data system to the query language supported by the data intake and query system. The data intake and query system then processes the query including the translated subquery. The translated subquery is then translated back to the language supported by the external data system including any processing or optimizations performed with respect to the subquery.
-
公开(公告)号:US20190138638A1
公开(公告)日:2019-05-09
申请号:US16051300
申请日:2018-07-31
Applicant: Splunk Inc.
Inventor: Sourav Pal , Arindam Bhattacharjee
Abstract: Systems and methods are disclosed for processing data chunks from different data sources at an execution node in a distributed execution environment. The execution node receives data chunks from different sources and combines data from groups of data chunks into partitions based on an associated data source. The execution node executes the partitions using one or more processors.
-
公开(公告)号:US09813528B2
公开(公告)日:2017-11-07
申请号:US14448928
申请日:2014-07-31
Applicant: Splunk Inc.
Inventor: Sourav Pal , Christopher Madden Pride
CPC classification number: H04L69/329 , H04L67/02 , H04L67/2804 , H04L67/2819 , H04L69/326
Abstract: Systems and methods for priority-based processing of messages received from multiple servers. An example method may comprise: receiving, by a first processing thread, in a non-blocking mode, a plurality of sub-application layer protocol packets from a plurality of servers; processing one or more sub-application layer protocol packets received from a first server of the plurality of servers, to produce a first application layer message; writing the first application layer message to a first message queue of a plurality of message queues associated with the plurality of servers, the first message queue corresponding to the first server; processing one or more sub-application layer protocol packets received from a second server of the plurality of servers, to produce a second application layer message; writing the second application layer message to a second message queue of a plurality of message queues associated with the plurality of servers, the second message queue corresponding to the second server; and reading, by a second processing thread, an application layer message having a most recent timestamp among a plurality of application layer messages in the plurality of message queues, the plurality of application layer messages including the first application layer message and the second application layer message.
-
94.
公开(公告)号:US20160036716A1
公开(公告)日:2016-02-04
申请号:US14448928
申请日:2014-07-31
Applicant: Splunk Inc.
Inventor: Sourav Pal , Christopher Madden Pride
IPC: H04L12/863 , H04L29/08 , H04L12/865
CPC classification number: H04L69/329 , H04L67/02 , H04L67/2804 , H04L67/2819 , H04L69/326
Abstract: Systems and methods for priority-based processing of messages received from multiple servers. An example method may comprise: receiving, by a first processing thread, in a non-blocking mode, a plurality of sub-application layer protocol packets from a plurality of servers; processing one or more sub-application layer protocol packets received from a first server of the plurality of servers, to produce a first application layer message; writing the first application layer message to a first message queue of a plurality of message queues associated with the plurality of servers, the first message queue corresponding to the first server; processing one or more sub-application layer protocol packets received from a second server of the plurality of servers, to produce a second application layer message; writing the second application layer message to a second message queue of a plurality of message queues associated with the plurality of servers, the second message queue corresponding to the second server; and reading, by a second processing thread, an application layer message having a most recent timestamp among a plurality of application layer messages in the plurality of message queues, the plurality of application layer messages including the first application layer message and the second application layer message.
Abstract translation: 用于基于优先级处理从多个服务器接收的消息的系统和方法。 示例性方法可以包括:由第一处理线程以非阻塞模式从多个服务器接收多个子应用层协议分组; 处理从所述多个服务器的第一服务器接收的一个或多个子应用层协议分组,以产生第一应用层消息; 将所述第一应用层消息写入与所述多个服务器相关联的多个消息队列的第一消息队列,所述第一消息队列对应于所述第一服务器; 处理从所述多个服务器的第二服务器接收的一个或多个子应用层协议分组,以产生第二应用层消息; 将所述第二应用层消息写入到与所述多个服务器相关联的多个消息队列的第二消息队列中,所述第二消息队列对应于所述第二服务器; 以及通过第二处理线程读取在所述多个消息队列中的多个应用层消息中具有最新时间戳的应用层消息,所述多个应用层消息包括所述第一应用层消息和所述第二应用层消息 。
-
公开(公告)号:US12204536B2
公开(公告)日:2025-01-21
申请号:US17658792
申请日:2022-04-11
Applicant: Splunk Inc.
Inventor: Sourav Pal , Arindam Bhattacharjee , Nikhil Roy
IPC: G06F16/00 , G06F16/17 , G06F16/22 , G06F16/242 , G06F16/2453 , G06F16/2458 , G06F16/25
Abstract: Systems and methods are described for scheduling a query for execution. The system receives and parses a query to identify one or more portions of the query. The system determines a resource allocation for each portion of the query, and determines an availability of compute resources for the different portions of the query. Based on the resource allocation and the availability of compute resources, the system schedules the query.
-
公开(公告)号:US11921672B2
公开(公告)日:2024-03-05
申请号:US16657872
申请日:2019-10-18
Applicant: Splunk Inc.
Inventor: Sourav Pal , Arindam Bhattacharjee , Timothy Tully
CPC classification number: G06F16/148 , G06F16/13 , G06F16/1734
Abstract: Systems and methods are described for executing a query of raw machine data that is stored at a remote data store that may store heterogeneous data. The system can determine the directories or file types that may store event data and may instruct one or more worker nodes to access files that may store events based on the determined directories of file types. Further, the system may exclude files at the remote data store that may not be identified as potentially storing events enabling a query that implicates a heterogeneous data store to be efficiently executed.
-
公开(公告)号:US11663212B2
公开(公告)日:2023-05-30
申请号:US17443811
申请日:2021-07-27
Applicant: Splunk Inc.
Inventor: Alexander Douglas James , Manu Jose , Sourav Pal , Christopher Madden Pride , Nicholas Robert Romito , Igor Braylovskiy , Arun Ramani , Ankit Jain
IPC: G06F16/00 , G06F16/2453 , G06F16/242 , G06F16/9535 , G06F40/205 , G06F9/54
CPC classification number: G06F16/24542 , G06F16/2425 , G06F16/9535 , G06F40/205 , G06F9/547
Abstract: Systems and methods are disclosed for processing and executing queries in a data intake and query system. The data intake and query system receives a query identifying a set of data to be processed and a manner of processing the set of data. The data intake and query system parses the query and uses a metadata catalog to dynamically identify configuration parameters of datasets and/or rules associated with the query. The identified configuration parameters are communicated to a query processing component of the data intake and query system for use in executing the query.
-
公开(公告)号:US11604795B2
公开(公告)日:2023-03-14
申请号:US16051304
申请日:2018-07-31
Applicant: Splunk Inc.
Inventor: Sourav Pal , Arindam Bhattacharjee
IPC: G06F17/00 , G06F16/2453 , G06F16/25 , G06F16/21 , G06F16/28 , G06F16/2455 , G06F16/2458 , G06F40/205
Abstract: Systems and methods are disclosed for executing a query that includes an indication to process data managed by an external data system. The system identifies the external data system that manages the data to be processed and generates a subquery for the external data system indicating that the results of the subquery are to be sent to one worker node of multiple worker nodes. The system instructs the one worker node to distribute the results received from the external data system to multiple worker nodes for processing.
-
公开(公告)号:US11500875B2
公开(公告)日:2022-11-15
申请号:US17086043
申请日:2020-10-30
Applicant: Splunk Inc.
Inventor: Arindam Bhattacharjee , Sourav Pal , Christopher Pride
Abstract: Systems and methods are disclosed for processing and executing queries against one or more dataset. As part of processing the query, the system determines whether the query is susceptible to a significantly imbalanced partition. In the event, the query is susceptible to an imbalanced partition, the system monitors the query and determines whether to perform a multi-partitioning determination to avoid a significantly imbalanced partition.
-
100.
公开(公告)号:US20220269727A1
公开(公告)日:2022-08-25
申请号:US17646841
申请日:2022-01-03
Applicant: Splunk Inc.
Inventor: Alexandros Batsakis , Sourav Pal , Sai Krishna Sajja , Igor Stojanovski , Tameem Anwar , Paul J. Lucas , Eric Woo , Steve Wong
IPC: G06F16/901 , G06F3/06 , G06F16/23 , G06F16/27 , G06F16/903
Abstract: Systems and methods are disclosed for processing and executing queries in a data intake and query system. The data intake and query system receives raw machine data at an indexing system, and stores at least a portion of the raw machine data in buckets using containerized indexing nodes instantiated in a containerized environment. The data intake and query system stores the buckets in a shared storage system.
-
-
-
-
-
-
-
-
-