SYSTEM AND METHOD FOR DISTRIBUTED DATABASE QUERY ENGINES

    公开(公告)号:US20160188677A1

    公开(公告)日:2016-06-30

    申请号:US15064559

    申请日:2016-03-08

    申请人: Facebook, Inc.

    IPC分类号: G06F17/30

    摘要: Techniques for a system capable of performing low-latency database query processing are disclosed herein. The system includes a gateway server and a plurality of worker nodes. The gateway server is configured to divide a database query, for a database containing data stored in a distributed storage cluster having a plurality of data nodes, into a plurality of partial queries and construct a query result based on a plurality of intermediate results. Each worker node of the plurality of worker nodes is configured to process a respective partial query of the plurality of partial queries by scanning data related to the respective partial query that stored on at least one data node of the distributed storage cluster and generate an intermediate result of the plurality of intermediate results that is stored in a memory of that worker node.

    SYSTEMS AND METHODS FOR CACHING OF SQL RESPONSES USING INTEGRATED CACHING
    32.
    发明申请
    SYSTEMS AND METHODS FOR CACHING OF SQL RESPONSES USING INTEGRATED CACHING 审中-公开
    使用集成缓存来处理SQL响应的系统和方法

    公开(公告)号:US20160110416A1

    公开(公告)日:2016-04-21

    申请号:US14978830

    申请日:2015-12-22

    IPC分类号: G06F17/30

    CPC分类号: G06F17/30457 G06F17/30132

    摘要: Systems and methods of the present disclosure provide for caching, by a device intermediary to a client and a database, a result of a structured query language (SQL) query request. In some embodiments, the device intermediary to a plurality of clients and a database receives a SQL response from the database to a first SQL query request of a client of the plurality of clients. The device may maintain a cache of SQL responses from the database. The device may identify that the first SQL query request matches a rule of a policy for caching SQL responses from the database. The policy may include a cache action to take when the rule is matched. The device may perform, responsive to the policy, on the SQL response the cache action identified by the policy.

    摘要翻译: 本公开的系统和方法提供了由客户端和数据库的中介器缓存结构化查询语言(SQL)查询请求的结果。 在一些实施例中,多个客户机和数据库的设备中介器从数据库接收到对多个客户端的客户端的第一个SQL查询请求的SQL响应。 该设备可以维护来自数据库的SQL响应缓存。 该设备可能会识别第一个SQL查询请求与缓存数据库中的SQL响应的策略规则相匹配。 策略可以包括匹配规则时要采取的缓存操作。 该设备可以响应策略来执行由策略标识的缓存动作的SQL响应。

    Scalable acquisition of telemetry data from instrumented systems enitities over a wireless network
    33.
    发明授权
    Scalable acquisition of telemetry data from instrumented systems enitities over a wireless network 有权
    通过无线网络可扩展地获取来自仪器化系统的遥测数据

    公开(公告)号:US09313560B2

    公开(公告)日:2016-04-12

    申请号:US12487999

    申请日:2009-06-19

    IPC分类号: H04Q9/00 G06F17/30

    摘要: A telemetry data acquisition management system includes a system processor and an interface engine, controlled by the system processor, for interfacing with sensor bearing systems, to receive telemetry data from the sensor bearing systems, and distribute the data to a plurality data processing systems or applications operational for processing telemetry data according to each sensor bearing systems' protocol. The system processor enables the plurality of multiple data processing systems or applications to specify telemetry requests including “fuzzy” timeliness protocol, generates a charging structure such that the sensor bearing systems are charge by usage commensurate with system load.

    摘要翻译: 遥测数据采集管理系统包括由系统处理器控制的系统处理器和接口引擎,用于与传感器轴承系统接口,以从传感器轴承系统接收遥测数据,并将数据分配到多个数据处理系统或应用 根据每个传感器轴承系统协议处理遥测数据的操作。 系统处理器使多个多个数据处理系统或应用能够指定包括“模糊”及时性协议的遥测请求,产生充电结构,使得传感器轴承系统通过与系统负载相当的使用来计费。

    Distributed Cache for Graph Data
    34.
    发明申请
    Distributed Cache for Graph Data 审中-公开
    分布式缓存用于图形数据

    公开(公告)号:US20160085881A1

    公开(公告)日:2016-03-24

    申请号:US14954675

    申请日:2015-11-30

    申请人: Facebook, Inc.

    IPC分类号: G06F17/30

    摘要: In one embodiment, a system comprises a database operative to maintain a social graph, a leader cache layer comprising one or more leader cache clusters, and a follower cache layer comprising one or more follower cache clusters, wherein the leader cache layer is operative to, communicate social graph information between the follower cache cluster and the database, wherein each follower cache cluster maintains at least a portion of the social graph, receive a request from one of the follower cache clusters to store social graph information in the database, update the database storing the social graph responsive to the request, and update one or more of the follower cache clusters storing the portion of the social graph associated with the request.

    摘要翻译: 在一个实施例中,系统包括可操作以维护社交图的数据库,包括一个或多个前导缓存集群的引导者高速缓存层以及包括一个或多个跟随器高速缓存群集的从属缓存层,其中,所述引导高速缓存层可操作, 在跟随缓存集群和数据库之间传送社交图表信息,其中每个跟随缓存集群维护至少一部分社交图,从一个跟随缓存集群接收请求以将社交图信息存储在数据库中,更新数据库 存储响应于该请求的社交图,并且更新存储与该请求相关联的该社交图的部分的一个或多个跟随缓存集群。

    Autonomic caching for in memory data grid query processing
    36.
    发明授权
    Autonomic caching for in memory data grid query processing 有权
    用于内存数据网格查询处理的自动缓存

    公开(公告)号:US09251209B2

    公开(公告)日:2016-02-02

    申请号:US13421764

    申请日:2012-03-15

    IPC分类号: G06F17/30

    摘要: A method, system and computer program product for autonomic caching in an IMDG has been provided. A method for autonomic caching in an IMDG includes receiving from a client of the IMDG a request for a primary query in the IMDG. The method also includes associating the primary query with a previously requested sub-query related to the primary query. Finally, the method includes directing the sub-query concurrently with a directing of the primary query without waiting to receive a request for the sub-query from the client. In this way, the method can proactively predict a receipt of the request for a sub-query following a request for a primary query prior the actual receipt of the request for the sub-query.

    摘要翻译: 已经提供了一种用于IMDG自主缓存的方法,系统和计算机程序产品。 在IMDG中自动缓存的方法包括从IMDG的客户端接收对IMDG中的主要查询的请求。 该方法还包括将主查询与先前请求的与主查询相关的子查询相关联。 最后,该方法包括在不等待从客户端接收对子查询的请求的情况下同时指导主查询来指导子查询。 以这种方式,在实际接收到子查询的请求之前,该方法可以主动地预测在对主查询的请求之后对子查询的请求的接收。

    Generating and Storing Summarization Tables for Sets of Searchable Events
    37.
    发明申请
    Generating and Storing Summarization Tables for Sets of Searchable Events 有权
    生成和存储可搜索事件集合的汇总表

    公开(公告)号:US20160004750A1

    公开(公告)日:2016-01-07

    申请号:US14815973

    申请日:2015-08-01

    申请人: Splunk Inc.

    IPC分类号: G06F17/30

    摘要: Embodiments are directed are towards the transparent summarization of events. Queries directed towards summarizing and reporting on event records may be received at a search head. Search heads may be associated with one more indexers containing event records. The search head may forward the query to the indexers the can resolve the query for concurrent execution. If a query is a collection query, indexers may generate summarization information based on event records located on the indexers. Event record fields included in the summarization information may be determined based on terms included in the collection query. If a query is a stats query, each indexer may generate a partial result set from previously generated summarization information, returning the partial result sets to the search head. Collection queries may be saved and scheduled to run and periodically update the summarization information.

    摘要翻译: 实施例针对事件的透明总结。 可以在搜索头收到针对事件记录的总结和报告的查询。 搜索头可能与一个包含事件记录的索引器相关联。 搜索头可以将查询转发给索引器,可以解析用于并发执行的查询。 如果查询是集合查询,则索引器可以基于位于索引器上的事件记录生成摘要信息。 包含在汇总信息中的事件记录字段可以基于收集查询中包含的项来确定。 如果查询是统计查询,则每个索引器可以从先前生成的摘要信息生成部分结果集,将部分结果集返回到搜索头。 收集查询可以保存并计划运行,并定期更新摘要信息。

    Distributed cache for graph data
    38.
    发明授权
    Distributed cache for graph data 有权
    图形数据的分布式缓存

    公开(公告)号:US09208207B2

    公开(公告)日:2015-12-08

    申请号:US14577190

    申请日:2014-12-19

    申请人: Facebook, Inc.

    IPC分类号: G06F12/08 G06F17/30

    摘要: In one embodiment, a system includes a database operative to maintain a social graph; and a cache layer comprising a plurality of data shards, the data shards being divided among a plurality of cache nodes of a cache layer, wherein each data shard is operative to: maintain at least a portion of the social graph; receive a request to store associations between a first graph node and a second graph node of the social graph, wherein the first and second graph nodes are identified by a first and second unique identifier, respectively, the first and second graph nodes each corresponding to a particular data shard of the plurality of data shards; and update, responsive to the request, the data shard corresponding to the first graph node and the data shard corresponding to the second graph node.

    摘要翻译: 在一个实施例中,系统包括可操作以维护社交图的数据库; 以及包括多个数据碎片的高速缓存层,所述数据碎片在高速缓存层的多个高速缓存节点之间被划分,其中每个数据碎片可操作以:保持社交图的至少一部分; 接收存储社交图的第一图形节点和第二图形节点之间的关联的请求,其中第一和第二图形节点分别由第一和第二唯一标识符标识,第一和第二图形节点分别对应于 所述多个数据分片中的特定数据分片; 并且响应于该请求更新与第一图形节点相对应的数据分片和对应于第二图形节点的数据分片。

    Search suggestions using fuzzy-score matching and entity co-occurrence
    39.
    发明授权
    Search suggestions using fuzzy-score matching and entity co-occurrence 有权
    使用模糊分数匹配和实体同现搜索建议

    公开(公告)号:US09208204B2

    公开(公告)日:2015-12-08

    申请号:US14558036

    申请日:2014-12-02

    申请人: QBASE, LLC

    IPC分类号: G06F17/30

    摘要: A method for generating search suggestions by using fuzzy-score matching and entity co-occurrence in a knowledge base is disclosed. Embodiments of the method may be employed in any search system that may include an entity extraction computer module that may perform partial entity extractions from provided search queries, a fuzzy-score matching computer module that may generate algorithms based on the type of entity extracted and perform a search against an entity co-occurrence knowledge base. The entity co-occurrence knowledge base, which may include a repository where entities may be indexed as entities to entities, entities to topics, or entities to facts among others, may return fast and accurate suggestions to the user to complete the search query. The suggestions may include alternates to the partial query provided by the user that may enhance and save time when performing searches.

    摘要翻译: 公开了一种通过在知识库中使用模糊分数匹配和实体共现来生成搜索建议的方法。 该方法的实施例可以用于可以包括可以从提供的搜索查询执行部分实体提取的实体提取计算机模块的任何搜索系统,可以基于提取的实体的类型来执行算法的模糊分数匹配计算机模块 搜索实体同现知识库。 可以包括实体可以被索引为实体的实体,到主题的实体或者事实的实体的实体同现知识库可以向用户返回快速和准确的建议以完成搜索查询。 建议可能包括替代用户提供的部分查询,可以增强和节省执行搜索时的时间。

    Efficient query rewriting
    40.
    发明授权
    Efficient query rewriting 有权
    高效的查询重写

    公开(公告)号:US09165033B1

    公开(公告)日:2015-10-20

    申请号:US14154024

    申请日:2014-01-13

    申请人: Google Inc.

    IPC分类号: G06F17/30

    摘要: Methods and systems for efficient query rewriting and the like are described here. One such described method comprises: offline mapping frequently-seen search queries to rewritten queries that may be better for searching; offline caching the mapping in a cache memory; and upon receiving a search query from a user similar to one of the mapped search queries, obtaining a corresponding rewritten query from the mapping in the cache memory based on predetermined conditions, and issuing a search of the rewritten query to the backend data system in order to avoid having to issue a search query to the backend data system twice while the user is online.

    摘要翻译: 这里描述了用于高效查询重写的方法和系统等。 一种这样描述的方法包括:将经常看到的搜索查询离线映射到可能更好地用于搜索的重写查询; 离线缓存高速缓存中的映射; 并且在接收到来自类似于所映射的搜索查询之一的用户的搜索查询时,基于预定条件从高速缓冲存储器中的映射获得相应的重写查询,并按顺序向后端数据系统发出重写查询的搜索 以避免在用户在线时必须向后端数据系统发出两次搜索查询。