Custom operators for a parallel query engine
    1.
    发明授权
    Custom operators for a parallel query engine 有权
    用于并行查询引擎的自定义运算符

    公开(公告)号:US08521721B2

    公开(公告)日:2013-08-27

    申请号:US12882168

    申请日:2010-09-14

    IPC分类号: G06F7/00 G06F17/30

    CPC分类号: G06F17/30445

    摘要: Embodiments are directed to implementing custom operators in a query for a parallel query engine and to generating a partitioned representation of a sequence of query operators in a parallel query engine. A computer system receives a portion of partitioned input data at a parallel query engine, where the parallel query engine is configured to process data queries in parallel, and where the queries include a sequence of built-in operators. The computer system incorporates a custom operator into the sequence of built-in operators for a query and accesses the sequence of operators to determine how the partitioned input data is to be processed. The custom operator is accessed in the same manner as the built-in operators. The computer system also processes the sequence of operators including both the built-in operators and at least one custom operator according to the determination indicating how the data is to be processed.

    摘要翻译: 实施例涉及在并行查询引擎的查询中实现自定义运算符并且在并行查询引擎中生成查询运算符序列的分区表示。 计算机系统在并行查询引擎处接收分割的输入数据的一部分,其中并行查询引擎被配置为并行处理数据查询,并且查询包括一系列内置运算符。 计算机系统将定制运算符合并到用于查询的内置运算符序列中,并访问运算符序列以确定如何处理分区输入数据。 以与内置运算符相同的方式访问定制运算符。 计算机系统还根据指示如何处理数据的确定来处理包括内置运算符和至少一个定制运算符的运算符序列。

    CUSTOM OPERATORS FOR A PARALLEL QUERY ENGINE
    2.
    发明申请
    CUSTOM OPERATORS FOR A PARALLEL QUERY ENGINE 有权
    并行查询引擎的定制操作员

    公开(公告)号:US20120066250A1

    公开(公告)日:2012-03-15

    申请号:US12882168

    申请日:2010-09-14

    IPC分类号: G06F17/30

    CPC分类号: G06F17/30445

    摘要: Embodiments are directed to implementing custom operators in a query for a parallel query engine and to generating a partitioned representation of a sequence of query operators in a parallel query engine. A computer system receives a portion of partitioned input data at a parallel query engine, where the parallel query engine is configured to process data queries in parallel, and where the queries include a sequence of built-in operators. The computer system incorporates a custom operator into the sequence of built-in operators for a query and accesses the sequence of operators to determine how the partitioned input data is to be processed. The custom operator is accessed in the same manner as the built-in operators. The computer system also processes the sequence of operators including both the built-in operators and at least one custom operator according to the determination indicating how the data is to be processed.

    摘要翻译: 实施例涉及在并行查询引擎的查询中实现自定义运算符并且在并行查询引擎中生成查询运算符序列的分区表示。 计算机系统在并行查询引擎处接收分割的输入数据的一部分,其中并行查询引擎被配置为并行处理数据查询,并且查询包括一系列内置运算符。 计算机系统将定制运算符合并到用于查询的内置运算符序列中,并访问运算符序列以确定如何处理分区输入数据。 以与内置运算符相同的方式访问定制运算符。 计算机系统还根据指示如何处理数据的确定来处理包括内置运算符和至少一个定制运算符的运算符序列。

    Parallel query engine with dynamic number of workers
    3.
    发明授权
    Parallel query engine with dynamic number of workers 有权
    具有动态数量的工作人员的并行查询引擎

    公开(公告)号:US08392920B2

    公开(公告)日:2013-03-05

    申请号:US12695049

    申请日:2010-01-27

    IPC分类号: G06F9/40 G06F9/44 G06F9/46

    CPC分类号: G06F9/4881 G06F2209/483

    摘要: Partitioning query execution work of a sequence including a plurality of elements. A method includes a worker core requesting work from a work queue. In response, the worker core receives a task from the work queue. The task is a replicable sequence-processing task including two distinct steps: scheduling a copy of the task on the scheduler queue and processing a sequence. The worker core processes the task by: creating a replica of the task and placing the replica of the task on the work queue, and beginning processing the sequence. The acts are repeated for one or more additional worker cores, where receiving a task from the work queue is performed by receiving one or more replicas of tasks placed on the task queue by earlier performances of creating a replica of the task and placing the replica of the task on the work queue by a different worker core.

    摘要翻译: 分割包含多个元素的序列的查询执行工作。 一种方法包括从工作队列请求工作的工作者核心。 作为响应,工作核心从工作队列接收任务。 该任务是可重复的序列处理任务,其包括两个不同的步骤:在调度器队列上调度任务的副本并处理序列。 工作核心通过以下方式来处理任务:创建任务的副本并将任务的副本放在工作队列上,并开始处理序列。 对于一个或多个额外的工作核心重复执行动作,其中从工作队列接收任务通过接收一个或多个放置在任务队列上的任务的副本来执行,以通过较早的创建该任务副本的性能并将副本 工作队列中的任务由不同的工作人员核心。

    PARALLEL QUERY ENGINE WITH DYNAMIC NUMBER OF WORKERS
    4.
    发明申请
    PARALLEL QUERY ENGINE WITH DYNAMIC NUMBER OF WORKERS 有权
    平行查询引擎与动员数量的工人

    公开(公告)号:US20110185358A1

    公开(公告)日:2011-07-28

    申请号:US12695049

    申请日:2010-01-27

    IPC分类号: G06F9/46

    CPC分类号: G06F9/4881 G06F2209/483

    摘要: Partitioning query execution work of a sequence including a plurality of elements. A method includes a worker core requesting work from a work queue. In response, the worker core receives a task from the work queue. The task is a replicable sequence-processing task including two distinct steps: scheduling a copy of the task on the scheduler queue and processing a sequence. The worker core processes the task by: creating a replica of the task and placing the replica of the task on the work queue, and beginning processing the sequence. The acts are repeated for one or more additional worker cores, where receiving a task from the work queue is performed by receiving one or more replicas of tasks placed on the task queue by earlier performances of creating a replica of the task and placing the replica of the task on the work queue by a different worker core.

    摘要翻译: 分割包含多个元素的序列的查询执行工作。 一种方法包括从工作队列请求工作的工作者核心。 作为响应,工作核心从工作队列接收任务。 该任务是可重复的序列处理任务,其包括两个不同的步骤:在调度器队列上调度任务的副本并处理序列。 工作核心通过以下方式来处理任务:创建任务的副本并将任务的副本放在工作队列上,并开始处理序列。 对于一个或多个额外的工作核心重复执行动作,其中从工作队列接收任务通过接收一个或多个放置在任务队列上的任务的副本来执行,以通过较早的创建该任务副本的性能并将 工作队列中的任务由不同的工作人员核心。

    Pattern-based compilation of asynchronous consumption
    5.
    发明授权
    Pattern-based compilation of asynchronous consumption 有权
    基于模式的异步消耗编译

    公开(公告)号:US08918767B2

    公开(公告)日:2014-12-23

    申请号:US13162288

    申请日:2011-06-16

    IPC分类号: G06F9/45 G06F9/44

    CPC分类号: G06F8/456

    摘要: The present invention extends to methods, systems, and computer program products for transforming source code to await execution of asynchronous operations. Embodiments of the invention simplify authoring and use of asynchronous methods, by generating statements that use well-defined awaitable objects to await completion of asynchronous operations. For example, a computer system can transform a statement that requests to await the completion of an asynchronous operation into a plurality of statements that use a predefined pattern of members of an awaitable object corresponding the asynchronous operation. The pattern can include one or more members configured to return a completion status of the asynchronous operation, one or more members configured to resume execution of the asynchronous method at a resumption point when the asynchronous operation completes, and one or more members configured to retrieve completion results. Accordingly, the plurality of statements can use these members to await execution of the asynchronous operation.

    摘要翻译: 本发明扩展到用于转换源代码以等待执行异步操作的方法,系统和计算机程序产品。 本发明的实施例简化了异步方法的编写和使用,通过生成使用明确定义的等待对象等待完成异步操作的语句。 例如,计算机系统可以将请求等待完成异步操作的语句转换为使用对应于异步操作的可等待对象的成员的预定义模式的多个语句。 该模式可以包括被配置为返回异步操作的完成状态的一个或多个成员,被配置成在异步操作完成时在恢复点恢复异步方法的执行的一个或多个成员以及被配置为检索完成的一个或多个成员 结果。 因此,多个语句可以使用这些成员来等待异步操作的执行。

    USING COMPILER-GENERATED TASKS TO REPRESENT PROGRAMMING ELEMENTS
    6.
    发明申请
    USING COMPILER-GENERATED TASKS TO REPRESENT PROGRAMMING ELEMENTS 有权
    使用编译器生成的任务来表示编程元素

    公开(公告)号:US20120324457A1

    公开(公告)日:2012-12-20

    申请号:US13162328

    申请日:2011-06-16

    IPC分类号: G06F9/46

    CPC分类号: G06F8/45

    摘要: The present invention extends to methods, systems, and computer program products for representing various programming elements with compiler-generated tasks. Embodiments of the invention enable access to the future state of a method through a handle to a single and composable task object. For example, an asynchronous method is rewritten to generate and return a handle to an instance of a builder object, which represents one or more future states of the asynchronous method. Information about operation of the asynchronous method is then passed through the handle. Accordingly, state of the asynchronous method is trackable prior to and after completing.

    摘要翻译: 本发明扩展到用于用编译器生成的任务表示各种编程元素的方法,系统和计算机程序产品。 本发明的实施例能够通过对单个和可组合任务对象的句柄来访问方法的未来状态。 例如,重写异步方法以生成并返回对构建器对象的实例的句柄,该对象表示异步方法的一个或多个未来状态。 关于异步方法的操作的信息然后通过句柄传递。 因此,异步方法的状态在完成之前和之后是可跟踪的。

    Permission based query processing
    7.
    发明授权
    Permission based query processing 有权
    基于权限查询处理

    公开(公告)号:US09183407B2

    公开(公告)日:2015-11-10

    申请号:US13283794

    申请日:2011-10-28

    IPC分类号: G06F7/00 G06F17/00 G06F21/62

    摘要: A technique for protecting the privacy of a query is provided using permissions that may be derived from an analysis of the context of the query. A monitoring component can be provided to receive or intercept queries directed at a datastore, and a privacy component is provided that analyzes permissions associated with the queries. The privacy component can also determine access levels of the queries based on the analysis of the permissions. A response component can then be provided to answer the queries in accordance with the access levels of the queries.

    摘要翻译: 使用可以从查询的上下文的分析导出的许可来提供用于保护查询的隐私的技术。 可以提供监视组件来接收或拦截指向数据存储的查询,并提供分析与查询相关联的许可的隐私组件。 隐私组件还可以基于对权限的分析来确定查询的访问级别。 然后可以提供响应组件以根据查询的访问级别来回答查询。

    QUERY RESULT ESTIMATION
    8.
    发明申请
    QUERY RESULT ESTIMATION 审中-公开
    查询结果估计

    公开(公告)号:US20130117257A1

    公开(公告)日:2013-05-09

    申请号:US13288947

    申请日:2011-11-03

    IPC分类号: G06F17/30

    CPC分类号: G06F16/2462 G06F16/2453

    摘要: Techniques for efficiently performing queries are provided. A search component can receive a request for information based on data, and a management component can determine a degree of accuracy requested for the information. In turn, the search component can render the information based on the degree of accuracy requested. In an aspect, the search generates a query configured to determine the first information, and the management component instructs the search component to perform the query to a level of completion less than full completion when the degree of accuracy requested is below a predetermined threshold to cause the search component to render an estimation of the first information. In another aspect, a tracking component can track information associated with multiple query requests and an analysis determine and employ a related aspect of the tracked information to a new query request to determine an answer for a the new query request.

    摘要翻译: 提供了有效执行查询的技术。 搜索组件可以基于数据接收对信息的请求,并且管理组件可以确定为该信息请求的准确度。 反过来,搜索组件可以基于请求的准确度来呈现信息。 在一个方面,搜索生成被配置为确定第一信息的查询,并且当所请求的准确度低于预定阈值时,管理组件指令搜索组件执行查询到小于完全完成的级别,以导致 搜索组件来呈现第一信息的估计。 在另一方面,跟踪组件可以跟踪与多个查询请求相关联的信息,并且分析确定并使用跟踪信息的相关方面到新的查询请求,以确定新查询请求的答案。

    Using compiler-generated tasks to represent programming elements
    9.
    发明授权
    Using compiler-generated tasks to represent programming elements 有权
    使用编译器生成的任务来表示编程元素

    公开(公告)号:US08572585B2

    公开(公告)日:2013-10-29

    申请号:US13162328

    申请日:2011-06-16

    IPC分类号: G06F9/45

    CPC分类号: G06F8/45

    摘要: The present invention extends to methods, systems, and computer program products for representing various programming elements with compiler-generated tasks. Embodiments of the invention enable access to the future state of a method through a handle to a single and composable task object. For example, an asynchronous method is rewritten to generate and return a handle to an instance of a builder object, which represents one or more future states of the asynchronous method. Information about operation of the asynchronous method is then passed through the handle. Accordingly, state of the asynchronous method is trackable prior to and after completing.

    摘要翻译: 本发明扩展到用于用编译器生成的任务表示各种编程元素的方法,系统和计算机程序产品。 本发明的实施例能够通过对单个和可组合任务对象的句柄来访问方法的未来状态。 例如,重写异步方法以生成并返回对构建器对象的实例的句柄,该对象表示异步方法的一个或多个未来状态。 关于异步方法的操作的信息然后通过句柄传递。 因此,异步方法的状态在完成之前和之后是可追踪的。

    PERMISSION BASED QUERY PROCESSING
    10.
    发明申请
    PERMISSION BASED QUERY PROCESSING 有权
    基于权限的查询处理

    公开(公告)号:US20130110876A1

    公开(公告)日:2013-05-02

    申请号:US13283794

    申请日:2011-10-28

    IPC分类号: G06F17/30

    摘要: Permission based query processing techniques are provided for protecting privacy. A monitoring component can be provided to receive or intercept queries directed at a datastore, and a privacy component is provided that analyzes permissions associated with the queries. The privacy component can also determine access levels of the queries based on the analysis of the permissions. A response component can then be provided to answer the queries in accordance with the access levels of the queries. While the response component is answering the queries, it can also mask the data in the datastore through a variety of techniques disclosed herein. In other embodiments, query responses can be filtered based on query contexts and data from two or more datastores can be compared and similarities identified without exposing the data from either datastore.

    摘要翻译: 提供基于权限的查询处理技术来保护隐私。 可以提供监视组件来接收或拦截指向数据存储的查询,并提供分析与查询相关联的许可的隐私组件。 隐私组件还可以基于对权限的分析来确定查询的访问级别。 然后可以提供响应组件以根据查询的访问级别来回答查询。 当响应组件正在回答查询时,它还可以通过本文公开的各种技术来掩蔽数据存储区中的数据。 在其他实施例中,可以基于查询上下文来过滤查询响应,并且可以比较来自两个或更多个数据存储的数据,并且识别相似性而不暴露来自任一数据存储的数据。