Invention Grant
- Patent Title: Dynamic scheduling of tasks for collecting and processing data from external sources
- Patent Title (中): 从外部来源收集和处理数据的任务的动态调度
-
Application No.: US13953568Application Date: 2013-07-29
-
Publication No.: US08978036B2Publication Date: 2015-03-10
- Inventor: Tristan Fletcher , Brian Bingham
- Applicant: Splunk Inc.
- Applicant Address: US CA San Francisco
- Assignee: Splunk Inc.
- Current Assignee: Splunk Inc.
- Current Assignee Address: US CA San Francisco
- Agency: Haynes Beffel & Wolfeld LLP
- Agent Ernest J. Beffel, Jr.
- Main IPC: G06F9/46
- IPC: G06F9/46 ; G06F9/50

Abstract:
A scheduler manages execution of a plurality of data-collection jobs, assigns individual jobs to specific forwarders in a set of forwarders, and generates and transmits tokens (e.g., pairs of data-collection tasks and target sources) to assigned forwarders. The forwarder uses the tokens, along with stored information applicable across jobs, to collect data from the target source and forward it onto an indexer for processing. For example, the indexer can then break a data stream into discrete events, extract a timestamp from each event and index (e.g., store) the event based on the timestamp. The scheduler can monitor forwarders' job performance, such that it can use the performance to influence subsequent job assignments. Thus, data-collection jobs can be efficiently assigned to and executed by a group of forwarders, where the group can potentially be diverse and dynamic in size.
Public/Granted literature
- US20130318536A1 DYNAMIC SCHEDULING OF TASKS FOR COLLECTING AND PROCESSING DATA FROM EXTERNAL SOURCES Public/Granted day:2013-11-28
Information query