Invention Grant
- Patent Title: Dynamic resource allocation for common storage query
-
Application No.: US15665302Application Date: 2017-07-31
-
Publication No.: US10795884B2Publication Date: 2020-10-06
- Inventor: Arindam Bhattacharjee , Sourav Pal , Ramkumar Chandrasekharan
- Applicant: Splunk Inc.
- Applicant Address: US CA San Francisco
- Assignee: Splunk Inc.
- Current Assignee: Splunk Inc.
- Current Assignee Address: US CA San Francisco
- Agency: Knobbe Martens, Olson & Bear, LLP
- Main IPC: G06F16/00
- IPC: G06F16/00 ; G06F16/2453 ; G06F16/2458 ; G06F16/33 ; G06F16/2455

Abstract:
Systems and methods are disclosed for processing queries against a common storage utilizing dynamically allocated partitions operating on one or more worker nodes. The common storage can include one or more data stores, which collectively contain a data set divided across multiple buckets of data. To query the common storage, a query coordinator can retrieve metadata regarding the multiple buckets, in order to determine a subset of buckets that are potentially relevant to a query. The query coordinator can then dynamically allocate partitions operating on worker nodes to retrieve and intake individual buckets of the subset into a phased search process. The dynamic allocation can be selected to maximize parallelization of the buckets across partitions, thus increasing a speed at which the common storage can be searched.
Public/Granted literature
- US20180089262A1 DYNAMIC RESOURCE ALLOCATION FOR COMMON STORAGE QUERY Public/Granted day:2018-03-29
Information query