Periodically Processing Data In Files Identified Using Checksums

    公开(公告)号:US20170344576A1

    公开(公告)日:2017-11-30

    申请号:US15663652

    申请日:2017-07-28

    Applicant: Splunk Inc.

    CPC classification number: G06F16/1734 G06F16/174 G06F16/20

    Abstract: Embodiments are directed towards managing and tracking item identification of a plurality of items to determine if an item is a new or existing item, where an existing item has been previously processed. In some embodiments, two or more item identifiers may be generated. In one embodiment, generating the two or more item identifiers may include analyzing the item using a small item size characteristic, a compressed item, or for an identifier collision. The two or more item identifiers may be employed to determine if the item is a new or existing item. In one embodiment, the two or more item identifiers may be compared to a record about an existing item to determine if the item is a new or existing item. If the item is an existing item, then the item may be further processed to determine if the existing item has actually changed.

    INTERACTIVE SELECTION AND DISPLAY OF A RAW DATA PARSING RULE
    14.
    发明申请
    INTERACTIVE SELECTION AND DISPLAY OF A RAW DATA PARSING RULE 有权
    互动选择和显示原始数据分配规则

    公开(公告)号:US20160342696A1

    公开(公告)日:2016-11-24

    申请号:US15224655

    申请日:2016-07-31

    Applicant: Splunk Inc.

    Abstract: Embodiments are directed towards previewing results generated from indexing data raw data before the corresponding index data is added to an index store. Raw data may be received from a preview data source. After an initial set of configuration information may be established, the preview data may be submitted to an index processing pipeline. A previewing application may generate preview results based on the preview index data and the configuration information. The preview results may enable previewing how the data is being processed by the indexing application. If the preview results are not acceptable, the configuration information may be modified. The preview application enables modification of the configuration information until the generated preview results may be acceptable. If the configuration information is acceptable, the preview data may be processed and indexed in one or more index stores.

    Abstract translation: 实施例针对在将对应的索引数据添加到索引存储之前预览从索引数据原始数据生成的结果。 可以从预览数据源接收原始数据。 在可以建立一组初始配置信息之后,可以将预览数据提交给索引处理流水线。 预览应用可以基于预览索引数据和配置信息生成预览结果。 预览结果可能可以预览索引应用程序如何处理数据。 如果预览结果不可接受,则可以修改配置信息。 预览应用程序可以修改配置信息,直到生成的预览结果可以接受。 如果配置信息是可接受的,则预览数据可以在一个或多个索引存储中被处理和索引。

    FLEXIBLE SCHEMA COLUMN STORE
    20.
    发明申请
    FLEXIBLE SCHEMA COLUMN STORE 有权
    灵活的样板柱

    公开(公告)号:US20130311438A1

    公开(公告)日:2013-11-21

    申请号:US13662984

    申请日:2012-10-29

    Applicant: SPLUNK INC.

    Abstract: Embodiments are directed towards receiving and processing search queries directed towards relatively large sets of data. The data is stored in a record based datastore. From the stored data, field names, corresponding field values, and posting values may be determined. Posting values may be employed to locate records in the datastore that include the field names and field values. The field names, field values, and posting values may be employed to generate a lexicon. If queries are received, a lexicon query processor may employ the lexicon separate from the datastore to generate responses to the received queries. Queries may include clauses that may be processed using the lexicon separate from the datastore, such as, where clause expressions, group-by clause expressions, aggregation functions, or the like. A time values array may be used to enable queries to process group-by-time expressions that may return results grouped into sub-sets based on time ranges.

    Abstract translation: 实施例旨在接收和处理针对相对大的数据集的搜索查询。 数据存储在基于记录的数据存储中。 从存储的数据可以确定字段名称,对应的字段值和过帐值。 可以使用发布值来定位数据存储中包含字段名称和字段值的记录。 可以使用字段名称,字段值和发布值来生成词典。 如果接收到查询,则词典查询处理器可以使用与数据存储区分开的词典来生成对所接收的查询的响应。 查询可以包括可以使用从数据存储区分开的词典来处理的子句,例如where子句表达式,分组子句表达式,聚合函数等。 时间值数组可用于使查询能够处理按时间范围分组成子集的结果的逐个逐句表达式。

Patent Agency Ranking