Data forwarder prioritizing live data

    公开(公告)号:US10055312B2

    公开(公告)日:2018-08-21

    申请号:US15665001

    申请日:2017-07-31

    Applicant: SPLUNK INC.

    Abstract: In accordance with implementations of the present disclosure, a backup of live data received by a data forwarder is generated at the data forwarder while the live data is provided to a real-time data pipeline for forwarding from the data forwarder. A a first portion of the live data is recovered from the backup to a stale data pipeline of the data forwarder. A request to forward the live data to a destination node is received by the data forwarder. In response to the request data is forwarded to the destination node, where the first portion of the live data from the stale data pipeline is added to a second portion of the live data from the real-time data pipeline in the response based on determining headroom remains to reach an amount of the data identified to include in the response.

    DYNAMIC DATA SERVER NODES
    42.
    发明申请
    DYNAMIC DATA SERVER NODES 有权
    动态数据服务器名称

    公开(公告)号:US20150295848A1

    公开(公告)日:2015-10-15

    申请号:US14686669

    申请日:2015-04-14

    Applicant: Splunk Inc.

    Abstract: A system of dynamically-instantiated data server components provides access to a data repository. Different data server components are assigned to different data collections in the repository. A distribution component receives messages and, based on data collection identifiers associated with the messages, routes the messages to corresponding data server components. Based on the messages, the data server components perform data operations with respect to their corresponding data collections. Data server components may be terminated when their assigned data collections are not in use. When an incoming message is associated with a data collection for which no data server component exists, the distribution component dynamically instantiates a new data server component for the data collection. In an embodiment, data server components make working copies of their respectively assigned data collections in a high-speed memory. By terminating inactive data server components, the system makes room in the memory for active data collections.

    Abstract translation: 动态实例化的数据服务器组件系统提供对数据存储库的访问。 不同的数据服务器组件被分配给存储库中的不同数据集合。 分发组件接收消息,并且基于与消息相关联的数据收集标识符将消息路由到相应的数据服务器组件。 基于消息,数据服务器组件对其相应的数据收集进行数据操作。 数据服务器组件可能在其分配的数据集合未被使用时终止。 当传入消息与不存在数据服务器组件的数据收集相关联时,分发组件动态实例化用于数据收集的新数据服务器组件。 在一个实施例中,数据服务器组件在高速存储器中产生其分配的数据集合的工作副本。 通过终止非活动数据服务器组件,系统在存储器中为活动数据集合腾出空间。

Patent Agency Ranking