公开(公告)号：US09843641B2

公开(公告)日：2017-12-12

申请号：US15355279

申请日：2016-11-18

Applicant: Google Inc.

Inventor： Michael Roger Marty ,  Nicholas Andrew Kidd ,  Marcus Fontoura ,  Charles Acknin

IPC: H04L29/08 ,  G06F9/50 ,  H04L29/06

CPC classification number: H04L67/16 ,  G06F9/5066 ,  H04L67/02 ,  H04L67/42

Abstract: Systems and methods include a distributed system that uses a declarative language to separate application logic from the network technology used to communicate. For example, in a system with a plurality of processing nodes, each processing node may include at least one processor, a networking layer for communicating with other processing nodes, and a memory storing instructions that, when executed by the at least one processor, cause the processing node to perform operations. The operations may include receiving a processing plan using the networking layer and analyzing the processing plan to determine a service to perform and a number of inputs anticipated for the service. The operations may also include performing the determined service. The processing plan defines a processing tree comprising a subset of the plurality of processing nodes, the processing tree having unidirectional communication from the root to a final level of the tree.

公开(公告)号：US08818971B1

公开(公告)日：2014-08-26

申请号：US13723898

申请日：2012-12-21

Applicant: Google Inc.

Inventor： Marcus Fontoura ,  Jan Hendrik Pieper ,  Krishna Tatavarthi ,  Bjoern Carlin ,  Hsiang-ling Lin

IPC: G06F17/30

CPC classification number: G06F17/3002 ,  G06F17/30283 ,  G06F17/30345

Abstract: Systems and methods for deleting non-key values from an index distributed over a plurality of computing devices maintains a non-key master list that includes the non-key values that are stored on each of the plurality of computing devices and receives a list of non-key values to delete. The systems and methods further intersect the list of non-key values to delete with the non-key master list, creating a first delete list for a first one of the plurality of computing devices that includes non-key values to be deleted that are stored on the first computing device. The systems and methods further transmit the first delete list to the first computing device and update the non-key master list based on the list of non-key values to delete.

Abstract translation: 用于从分布在多个计算设备上的索引中删除非键值的系统和方法维护非密钥主列表，其包括存储在多个计算设备中的每一个上的非密钥值，并且接收非列表的非密钥值， 要删除的键值。 所述系统和方法进一步与非密钥值列表相交，以与所述非密钥主列表一起删除，为所述多个计算设备中的第一个计算设备创建包括存储的要删除的非密钥值的第一删除列表 在第一个计算设备上。 系统和方法还将第一删除列表发送到第一计算设备，并且基于要删除的非密钥值的列表更新非密钥主列表。

公开(公告)号：US09501506B1

公开(公告)日：2016-11-22

申请号：US14107848

申请日：2013-12-16

Applicant: GOOGLE INC.

Inventor： Marcus Fontoura ,  Daniel N. Meredith ,  Douglas Lee Taylor Rohde ,  Mahesh S. Palekar ,  Asim Shankar ,  Denis Murray Baylor ,  Zigmars Rasscevskis ,  Andras Csomai

IPC: G06F17/30

CPC classification number: G06F17/30631

Abstract: A hybrid-sharded index includes document-sharded posting lists and term-sharded posting lists. Implementations include systems and methods for updating a hybrid-sharded index. For example, a method may include receiving updates to the hybrid-sharded index and generating, at a first leaf node, replacement posting lists and change information for a respective second leaf node. The method may also include dividing the replacement posting lists into portions, a portion having associated change information and being associated with a respective one of the second leaf nodes and sending the portions to respective leaf nodes. At a particular leaf node of the second leaf nodes, the method includes merging a received portion into an updated posing list portion, swapping the updated posting list portion into memory. During the swap, the change information and the updated posting list portion are used to respond to a query with an older version of the hybrid-sharded index.

Abstract translation: 混合分片索引包括文档分片的发布列表和条目分片的发布列表。 实现包括用于更新混合分片索引的系统和方法。 例如，方法可以包括接收对混合分片索引的更新，并且在第一叶节点处生成用于相应的第二叶节点的替换发布列表和改变信息。 该方法还可以包括将替换发布列表划分为部分，具有相关联的改变信息的部分，并且与相应的第二叶节点相关联，并将部分发送到相应的叶节点。 在第二叶节点的特定叶节点处，该方法包括将接收到的部分合并到更新的构图列表部分中，将更新的发布列表部分交换到存储器中。 在交换期间，更改信息和更新的发布列表部分用于响应具有旧版本的混合分片索引的查询。

公开(公告)号：US20160014236A1

公开(公告)日：2016-01-14

申请号：US14863979

申请日：2015-09-24

Applicant: Google Inc.

Inventor： Michael Roger Marty ,  Nicholas Andrew Kidd ,  Marcus Fontoura ,  Charles Acknin

IPC: H04L29/06 ,  H04L29/08

CPC classification number: H04L67/16 ,  G06F9/5066 ,  H04L67/02 ,  H04L67/42

Abstract: Systems and methods include a distributed system that uses a declarative language to separate application logic from the network technology used to communicate. For example, in a system with a plurality of processing nodes, each processing node may include at least one processor, a networking layer for communicating with other processing nodes, and a memory storing instructions that, when executed by the at least one processor, cause the processing node to perform operations. The operations may include receiving a processing plan using the networking layer and analyzing the processing plan to determine a service to perform and a number of inputs anticipated for the service. The operations may also include performing the determined service. The processing plan defines a processing tree comprising a subset of the plurality of processing nodes, the processing tree having unidirectional communication from the root to a final level of the tree.

Abstract translation: 系统和方法包括使用声明性语言将应用程序逻辑与用于通信的网络技术分离的分布式系统。 例如，在具有多个处理节点的系统中，每个处理节点可以包括至少一个处理器，用于与其他处理节点进行通信的联网层，以及存储存储指令的存储器，所述指令在由所述至少一个处理器执行时引起 处理节点执行操作。 操作可以包括使用网络层接收处理计划，并分析处理计划以确定要执行的服务以及为服务预期的多个输入。 操作还可以包括执行确定的服务。 处理计划定义了包括多个处理节点的子集的处理树，该处理树具有从树的根到最终级别的单向通信。

公开(公告)号：US20150317357A1

公开(公告)日：2015-11-05

申请号：US14268049

申请日：2014-05-02

Applicant: Google Inc.

Inventor： Jeremiah Harmsen ,  Tushar Deepak Chandra ,  Marcus Fontoura

IPC: G06F17/30 ,  G06N99/00

CPC classification number: G06F17/30424 ,  G06F17/30321 ,  G06F17/30622 ,  G06N5/025 ,  G06N99/005

Abstract: Systems and techniques are disclosed for generating entries for a searchable index based on rules generated by one or more machine-learned models. The index entries can include one or more tokens correlated with an outcome and an outcome probability. A subset of tokens can be identified based on the characteristics of an event. The index may be searched for outcomes and their respective probabilities that correspond to tokens that are similar to or match the subset of tokens based on the event.

Abstract translation: 公开了用于基于由一个或多个机器学习模型生成的规则为可搜索索引生成条目的系统和技术。 索引条目可以包括与结果相关联的一个或多个令牌和结果概率。 可以基于事件的特征来识别令牌子集。 搜索索引可以根据事件搜索与令牌子集相似或匹配的令牌对应的结果及其各自的概率。

公开(公告)号：US20140136590A1

公开(公告)日：2014-05-15

申请号：US13767286

申请日：2013-02-14

Applicant: Google Inc.

Inventor： Michael Roger Marty ,  Nicholas Andrew Kidd ,  Marcus Fontoura ,  Charles Acknin

IPC: H04L29/08

CPC classification number: H04L67/16 ,  G06F9/5066 ,  H04L67/02 ,  H04L67/42

Abstract: Systems and methods include a distributed system that uses a declarative language to separate application logic from the network technology used to communicate. For example, in a system with a plurality of processing nodes, each processing node may include at least one processor, a networking layer for communicating with other processing nodes, and a memory storing instructions that, when executed by the at least one processor, cause the processing node to perform operations. The operations may include receiving a processing plan using the networking layer and analyzing the processing plan to determine a service to perform and a number of inputs anticipated for the service. The operations may also include performing the determined service. The processing plan defines a processing tree comprising a subset of the plurality of processing nodes, the processing tree having unidirectional communication from the root to a final level of the tree.

Abstract translation: 系统和方法包括使用声明性语言将应用程序逻辑与用于通信的网络技术分离的分布式系统。 例如，在具有多个处理节点的系统中，每个处理节点可以包括至少一个处理器，用于与其他处理节点进行通信的联网层，以及存储存储指令的存储器，所述指令在由所述至少一个处理器执行时引起 处理节点执行操作。 操作可以包括使用网络层接收处理计划，并分析处理计划以确定要执行的服务以及为服务预期的多个输入。 操作还可以包括执行确定的服务。 处理计划定义了包括多个处理节点的子集的处理树，该处理树具有从树的根到最终级别的单向通信。

公开(公告)号：US20170070583A1

公开(公告)日：2017-03-09

申请号：US15355279

申请日：2016-11-18

Applicant: Google Inc.

Inventor： Michael Roger Marty ,  Nicholas Andrew Kidd ,  Marcus Fontoura ,  Charles Acknin

IPC: H04L29/08 ,  H04L29/06

CPC classification number: H04L67/16 ,  G06F9/5066 ,  H04L67/02 ,  H04L67/42

Abstract: Systems and methods include a distributed system that uses a declarative language to separate application logic from the network technology used to communicate. For example, in a system with a plurality of processing nodes, each processing node may include at least one processor, a networking layer for communicating with other processing nodes, and a memory storing instructions that, when executed by the at least one processor, cause the processing node to perform operations. The operations may include receiving a processing plan using the networking layer and analyzing the processing plan to determine a service to perform and a number of inputs anticipated for the service. The operations may also include performing the determined service. The processing plan defines a processing tree comprising a subset of the plurality of processing nodes, the processing tree having unidirectional communication from the root to a final level of the tree.

Abstract translation: 系统和方法包括使用声明性语言将应用程序逻辑与用于通信的网络技术分离的分布式系统。 例如，在具有多个处理节点的系统中，每个处理节点可以包括至少一个处理器，用于与其他处理节点进行通信的联网层，以及存储存储指令的存储器，所述指令在由所述至少一个处理器执行时引起 处理节点执行操作。 操作可以包括使用网络层接收处理计划，并分析处理计划以确定要执行的服务以及为服务预期的多个输入。 操作还可以包括执行确定的服务。 处理计划定义了包括多个处理节点的子集的处理树，该处理树具有从树的根到最终级别的单向通信。

公开(公告)号：US09531842B2

公开(公告)日：2016-12-27

申请号：US14863979

申请日：2015-09-24

Applicant: Google Inc.

Inventor： Michael Roger Marty ,  Nicholas Andrew Kidd ,  Marcus Fontoura ,  Charles Acknin

IPC: H04L29/06 ,  H04L29/08 ,  G06F9/50

CPC classification number: H04L67/16 ,  G06F9/5066 ,  H04L67/02 ,  H04L67/42

Abstract: Systems and methods include a distributed system that uses a declarative language to separate application logic from the network technology used to communicate. For example, in a system with a plurality of processing nodes, each processing node may include at least one processor, a networking layer for communicating with other processing nodes, and a memory storing instructions that, when executed by the at least one processor, cause the processing node to perform operations. The operations may include receiving a processing plan using the networking layer and analyzing the processing plan to determine a service to perform and a number of inputs anticipated for the service. The operations may also include performing the determined service. The processing plan defines a processing tree comprising a subset of the plurality of processing nodes, the processing tree having unidirectional communication from the root to a final level of the tree.

公开(公告)号：US09483568B1

公开(公告)日：2016-11-01

申请号：US14107851

申请日：2013-12-16

Applicant: GOOGLE INC.

Inventor： Marcus Fontoura ,  Daniel N. Meredith ,  Douglas Lee Taylor Rohde ,  Mahesh S. Palekar ,  Asim Shankar ,  Denis Murray Baylor ,  Zigmars Rasscevskis ,  Andras Csomai

IPC: G06F17/30

CPC classification number: G06F17/30864 ,  G06F17/30631

Abstract: A hybrid-sharded index includes document-sharded posting lists and term-sharded posting lists. Implementations include systems and methods using a distributed hybrid-sharded index. For example, a method may include receiving, at a root node, a query having a first term and a second term and determining, that the first term is term-sharded. The method may also include retrieving a term-sharded posting list for the first term from a first leaf node that stores the term-sharded posting list and determining, at the root node, a second leaf node that stores a document-sharded posting list for the second term. The method may include sending the second term and a sub-set of documents from the term-sharded posting list to the second leaf node, the sub-set being documents assigned to the second leaf node; and generating a search result using a response received from the second leaf node.

Abstract translation: 混合分片索引包括文档分片的发布列表和条目分片的发布列表。 实现包括使用分布式混合分片索引的系统和方法。 例如，一种方法可以包括在根节点处接收具有第一项和第二项的查询，并确定第一项是术语划分的。 所述方法还可以包括从存储所述术语分片的发布列表的第一叶节点检索用于所述第一术语的术语分片的发布列表，以及在所述根节点处确定存储文档分片的发布列表的第二叶节点， 第二学期 该方法可以包括将第二项和一组文档从该术语分片的发布列表发送到第二叶节点，该子集是分配给第二叶节点的文档; 以及使用从所述第二叶节点接收的响应来生成搜索结果。

公开(公告)号：US09185156B2

公开(公告)日：2015-11-10

申请号：US13767286

申请日：2013-02-14

Applicant: Google Inc.

Inventor： Michael Roger Marty ,  Nicholas Andrew Kidd ,  Marcus Fontoura ,  Charles Acknin

IPC: H04L29/08 ,  G06F9/50

CPC classification number: H04L67/16 ,  G06F9/5066 ,  H04L67/02 ,  H04L67/42

Abstract: Systems and methods include a distributed system that uses a declarative language to separate application logic from the network technology used to communicate. For example, in a system with a plurality of processing nodes, each processing node may include at least one processor, a networking layer for communicating with other processing nodes, and a memory storing instructions that, when executed by the at least one processor, cause the processing node to perform operations. The operations may include receiving a processing plan using the networking layer and analyzing the processing plan to determine a service to perform and a number of inputs anticipated for the service. The operations may also include performing the determined service. The processing plan defines a processing tree comprising a subset of the plurality of processing nodes, the processing tree having unidirectional communication from the root to a final level of the tree.

Abstract translation: 系统和方法包括使用声明性语言将应用程序逻辑与用于通信的网络技术分离的分布式系统。 例如，在具有多个处理节点的系统中，每个处理节点可以包括至少一个处理器，用于与其他处理节点进行通信的联网层，以及存储存储指令的存储器，所述指令在由所述至少一个处理器执行时引起 处理节点执行操作。 操作可以包括使用网络层接收处理计划，并分析处理计划以确定要执行的服务以及为服务预期的多个输入。 操作还可以包括执行确定的服务。 处理计划定义了包括多个处理节点的子集的处理树，该处理树具有从树的根到最终级别的单向通信。