Processing of streaming data with keyed aggregation
    11.
    发明授权
    Processing of streaming data with keyed aggregation 有权
    使用密钥聚合处理流数据

    公开(公告)号:US08868518B2

    公开(公告)日:2014-10-21

    申请号:US12541481

    申请日:2009-08-14

    IPC分类号: G06F17/30

    CPC分类号: G06F17/30516

    摘要: Keyed aggregation is used in the processing of streaming data to streamline processing to provide higher throughput and decreased use of resources. The most recent event for each unique replacement key value(s) is maintained. In response to an incoming event having a same key as a previous event, the effect on an aggregation of the previous event is removed. The aggregation is then updated with one or more values from the arriving event and the updated aggregation is output.

    摘要翻译: 密钥聚合用于处理流数据以简化处理,以提供更高的吞吐量和更少的资源使用。 维护每个唯一替换键值的最近事件。 响应于与先前事件具有相同键的传入事件,去除对先前事件的聚合的影响。 然后使用一个或多个值从到达事件更新聚合,并输出更新的聚合。

    Tracing flow of data in a distributed computing application
    13.
    发明授权
    Tracing flow of data in a distributed computing application 失效
    跟踪分布式计算应用程序中的数据流

    公开(公告)号:US08656369B2

    公开(公告)日:2014-02-18

    申请号:US12785916

    申请日:2010-05-24

    IPC分类号: G06F9/44

    CPC分类号: G06F11/3636

    摘要: A method is provided for tracing dataflow in a distributed computing application. For example, the method includes incrementally advancing a dataflow in a dataflow path of one or more dataflow paths according to two or more directives encoded in two or more data messages. The method further includes performing the two or more directives. The dataflow path includes one or more operators including at least one merge operator operative to merge the two or more data messages and merge the two or more directives. One or more of the incrementally advancing of the dataflow and the performing of the two or more directives are implemented as instruction code performed on a processor device.

    摘要翻译: 提供了一种用于在分布式计算应用程序中跟踪数据流的方法。 例如,该方法包括根据在两个或多个数据消息中编码的两个或更多个指令来逐步推进一个或多个数据流路径的数据流路径中的数据流。 该方法还包括执行两个或更多个指令。 数据流路径包括一个或多个运算符,包括至少一个合并运算符,用于合并两个或多个数据消息并合并两个或多个指令。 数据流的递增推进和两个或多个指令的执行中的一个或多个被实现为在处理器设备上执行的指令代码。

    Profile-driven data stream processing
    14.
    发明授权
    Profile-driven data stream processing 失效
    配置文件驱动的数据流处理

    公开(公告)号:US08601458B2

    公开(公告)日:2013-12-03

    申请号:US12465757

    申请日:2009-05-14

    IPC分类号: G06F9/45

    CPC分类号: G06F8/44 G06F8/433

    摘要: Techniques for compiling a data stream processing application are provided. The techniques include receiving, by a compiler executing on a computer system, source code for a data stream processing application, wherein the source code comprises source code for a plurality of operators, each of which performs a data processing function, determining, by the compiler, one or more characteristics of operators within the data stream processing application, grouping, by the compiler, the operators into one or more execution containers based on the one or more characteristics, and compiling, by the compiler, the source code for the data stream processing application into executable code, wherein the executable code comprises a plurality of execution units, wherein each execution unit contains one or more of the operators, wherein each operator is assigned to an execution unit based on the grouping, and wherein each execution unit is to be executed in a partition.

    摘要翻译: 提供了用于编译数据流处理应用的技术。 这些技术包括由在计算机系统上执行的编译器接收用于数据流处理应用的源代码,其中源代码包括用于多个运算符的源代码,每个运算符执行数据处理功能,由编译器确定 ,数据流处理应用中的运算符的一个或多个特征,由编译器根据一个或多个特征将运算符分组为一个或多个执行容器,并由编译器编译数据流的源代码 将应用程序处理成可执行代码,其中可执行代码包括多个执行单元,其中每个执行单元包含一个或多个运算符,其中每个运算符基于分组被分配给执行单元,并且其中每个执行单元是 在一个分区中执行。

    Method of selecting an expression evaluation technique for domain-specific language compilation
    16.
    发明授权
    Method of selecting an expression evaluation technique for domain-specific language compilation 失效
    选择域特定语言编译的表达评估技术的方法

    公开(公告)号:US08495595B2

    公开(公告)日:2013-07-23

    申请号:US12749947

    申请日:2010-03-30

    IPC分类号: G06F9/45

    CPC分类号: G06F9/45516 G06F8/51

    摘要: A method and computer program product for selecting an expression evaluation technique for domain-specific language (DSL) compilation. An application written in DSL for a programming task is provided, the application including a plurality of components configured by expressions. A technique that most quickly implements the programming task is selected from a plurality of techniques for evaluating the expressions. The DSL application is compiled in accordance with the selected expression evaluation technique to generate general-purpose programming language (GPL) code.

    摘要翻译: 一种用于选择域特定语言(DSL)编译的表达评估技术的方法和计算机程序产品。 提供了一种用DSL编写的用于编程任务的应用程序,该应用程序包括由表达式配置的多个组件。 从用于评估表达式的多种技术中选择最快速地实现编程任务的技术。 DSL应用程序根据所选择的表达式评估技术进行编译,以生成通用编程语言(GPL)代码。

    Partitioning operator flow graphs
    17.
    发明授权
    Partitioning operator flow graphs 有权
    分区操作员流程图

    公开(公告)号:US08490072B2

    公开(公告)日:2013-07-16

    申请号:US12489805

    申请日:2009-06-23

    IPC分类号: G06F9/44 G06F9/45

    CPC分类号: G06F8/443 G06F8/433 G06F8/44

    摘要: Techniques for partitioning an operator flow graph are provided. The techniques include receiving source code for a stream processing application, wherein the source code comprises an operator flow graph, wherein the operator flow graph comprises a plurality of operators, receiving profiling data associated with the plurality of operators and one or more processing requirements of the operators, defining a candidate partition as a coalescing of one or more of the operators into one or more sets of processing elements (PEs), using the profiling data to create one or more candidate partitions of the processing elements, using the one or more candidate partitions to choose a desired partitioning of the operator flow graph, and compiling the source code into an executable code based on the desired partitioning.

    摘要翻译: 提供了划分操作员流程图的技术。 所述技术包括接收流处理应用的源代码,其中所述源代码包括操作者流图,其中所述操作者流程图包括多个操作者,接收与所述多个操作者相关联的分析数据以及所述多个操作者的一个或多个处理要求 运营商,使用所述分析数据,使用所述一个或多个候选者来创建一个或多个所述处理元件的候选分区,将候选分区定义为将一个或多个运算符合并为一组或多组处理元素(PE) 分区以选择操作员流图的期望分区,并且基于期望的分区将源代码编译成可执行代码。

    Proxying open database connectivity (ODBC) calls
    18.
    发明授权
    Proxying open database connectivity (ODBC) calls 失效
    代理开放数据库连接(ODBC)调用

    公开(公告)号:US08321443B2

    公开(公告)日:2012-11-27

    申请号:US12876348

    申请日:2010-09-07

    IPC分类号: G06F17/30

    CPC分类号: G06F17/3056

    摘要: An Open Database Connectivity (ODBC) proxy infrastructure to transparently route incoming queries to one or more selected query engines. The ODBC proxy receives a query from an application, and determines based on the characteristics of the query and the capabilities of the query engines which one or more query engines are to perform the query. The proxy then routes the query to the one or more query engines, which perform the query. The results are then returned to the proxy, which provides the results to the application.

    摘要翻译: 开放数据库连接(ODBC)代理基础架构,用于将传入的查询透明地路由到一个或多个选定的查询引擎。 ODBC代理从应用程序接收查询,并根据查询的特征以及一个或多个查询引擎执行查询的查询引擎的功能进行确定。 然后,代理将查询路由到一个或多个执行查询的查询引擎。 然后将结果返回给代理,该代理将结果提供给应用程序。

    APPLICATION RESOURCE MODEL COMPOSITION FROM CONSTITUENT COMPONENTS
    19.
    发明申请
    APPLICATION RESOURCE MODEL COMPOSITION FROM CONSTITUENT COMPONENTS 审中-公开
    构成部件的应用资源模型组成

    公开(公告)号:US20120297391A1

    公开(公告)日:2012-11-22

    申请号:US13464386

    申请日:2012-05-04

    IPC分类号: G06F9/46

    CPC分类号: G06F9/5011 H04L41/5035

    摘要: Techniques for composing an application resource model are disclosed. The techniques include obtaining operator-level metrics from an execution of a data stream processing application according to a first configuration, wherein the application is executed by nodes of the data stream processing system and the application includes processing elements comprised of multiple operators, wherein two or more of the operators are combined in a first combination to form a processing element according to the first configuration, generating operator-level resource functions from the first combination of operators based on the obtained operator-level metrics, and generating a processing element-level resource function using the generated operator-level resource functions to predict a model for the processing element formed by a second combination of operators, the processing element-level resource function representing an application resource model usable for predicting characteristics of the application executed according to a second configuration.

    摘要翻译: 公开了组合应用资源模型的技术。 这些技术包括根据第一配置从数据流处理应用的执行获得运营商级度量,其中应用由数据流处理系统的节点执行,并且应用包括由多个运营商组成的处理元件,其中两个或 更多的运营商以第一组合组合以形成根据第一配置的处理元件,基于所获得的运营商级度量从运营商的第一组合生成运营商级资源功能,以及生成处理元件级资源 使用所生成的操作者级资源函数来预测由第二组合运算符形成的处理元素的模型,所述处理元素级资源函数表示可用于根据第二配置来执行的用于预测所述应用的特征的应用资源模型 。