System for deadlock condition detection and correction by allowing a queue limit of a number of data tokens on the queue to increase
    1.
    发明授权
    System for deadlock condition detection and correction by allowing a queue limit of a number of data tokens on the queue to increase 有权
    通过允许队列上的多个数据令牌的队列限制增加来进行死锁状态检测和校正的系统

    公开(公告)号:US07743382B2

    公开(公告)日:2010-06-22

    申请号:US10700281

    申请日:2003-11-03

    CPC分类号: G06F9/524 G06F8/10 G06F8/34

    摘要: The execution environment provides for scalability where components will execute in parallel and exploit various patterns of parallelism. Dataflow applications are represented by reusable dataflow graphs called map components, while the executable version is called a prepared map. Using runtime properties the prepared map is executed in parallel with a thread allocated to each map process. The execution environment not only monitors threads, detects and corrects deadlocks, logs and controls program exceptions, but also data input and output ports of the map components are processed in parallel to take advantage of data partitioning schemes. Port implementation supports multi-state null value tokens to more accurately report exceptions. Data tokens are batched to minimize synchronization and transportation overhead and thread contention.

    摘要翻译: 执行环境提供可扩展性,其中组件将并行执行并利用各种并行模式。 数据流应用程序由称为映射组件的可重用数据流图表示,而可执行版本称为准备映射。 使用运行时属性,准备的映射与分配给每个映射过程的线程并行执行。 执行环境不仅监视线程,检测和纠正死锁,记录和控制程序异常,还可以并行处理地图组件的数据输入和输出端口,以利用数据分区方案。 端口实现支持多状态空值令牌以更准确地报告异常。 批量数据令牌以最小化同步和传输开销和线程争用。

    Execution Environment for Data Transformation Applications
    2.
    发明申请
    Execution Environment for Data Transformation Applications 有权
    数据转换应用程序的执行环境

    公开(公告)号:US20100262968A1

    公开(公告)日:2010-10-14

    申请号:US12775229

    申请日:2010-05-06

    IPC分类号: G06F9/46 G06F11/07

    CPC分类号: G06F9/524 G06F8/10 G06F8/34

    摘要: The execution environment provides for scalability where components will execute in parallel and exploit various patterns of parallelism. Dataflow applications are represented by reusable dataflow graphs called map components, while the executable version is called a prepared map. Using runtime properties the prepared map is executed in parallel with a thread allocated to each map process. The execution environment not only monitors threads, detects and corrects deadlocks, logs and controls program exceptions, but also data input and output ports of the map components are processed in parallel to take advantage of data partitioning schemes. Port implementation supports multi-state null value tokens to more accurately report exceptions. Data tokens are batched to minimize synchronization and transportation overhead and thread contention.

    摘要翻译: 执行环境提供可扩展性,其中组件将并行执行并利用各种并行模式。 数据流应用程序由称为映射组件的可重用数据流图表示,而可执行版本称为准备映射。 使用运行时属性,准备的映射与分配给每个映射过程的线程并行执行。 执行环境不仅监视线程,检测和纠正死锁,记录和控制程序异常,还可以并行处理地图组件的数据输入和输出端口,以利用数据分区方案。 端口实现支持多状态空值令牌以更准确地报告异常。 批量数据令牌以最小化同步和传输开销和线程争用。

    Development environment for data transformation applications
    3.
    发明申请
    Development environment for data transformation applications 审中-公开
    数据转换应用的开发环境

    公开(公告)号:US20080052687A1

    公开(公告)日:2008-02-28

    申请号:US10700152

    申请日:2003-11-03

    IPC分类号: G06F9/45

    CPC分类号: G06F9/524 G06F8/10 G06F8/34

    摘要: An environment and method for developing dataflow applications where a dataflow transformation is encapsulated into a dataflow graph expressed as a reusable map component using a host development language such as Java®, and the dataflow graphs are linked together via ports. A scalar map component performs a specific data transformation and a composite map component is built from a number of other map components typically representing a family of data transformations. Map components have interface and implementation properties which assist in developing customized, hierarchical data transformation logic. The ports are polymorphic and can be specific, generic, or composite data types, to allow linking of map components which compile to generate a dataflow pattern. A map component may employ dynamic logic where internal sub-graphs or links are added or properties changed based on information received from the compiler, such as port types, design properties, or static data transformation.

    摘要翻译: 用于开发数据流转换的环境和方法,其中数据流转换被封装到使用诸如Java(R)的主机开发语言表示为可重用地图组件的数据流图中,并且数据流图通过端口链接在一起。 标量地图组件执行特定的数据变换,并且从通常表示一系列数据变换的多个其它映射组件构建复合映射组件。 地图组件具有接口和实现属性,有助于开发定制的分层数据转换逻辑。 这些端口是多态的,可以是特定的,通用的或复合的数据类型,以便链接编译以生成数据流模式的地图组件。 映射组件可以采用基于从编译器接收的信息(例如端口类型,设计属性或静态数据转换)来添加内部子图或链接或属性改变的动态逻辑。

    Execution environment for data transformation applications
    4.
    发明授权
    Execution environment for data transformation applications 有权
    数据转换应用程序的执行环境

    公开(公告)号:US08528000B2

    公开(公告)日:2013-09-03

    申请号:US12775229

    申请日:2010-05-06

    IPC分类号: G06F15/00 G06F17/50

    CPC分类号: G06F9/524 G06F8/10 G06F8/34

    摘要: The execution environment provides for scalability where components will execute in parallel and exploit various patterns of parallelism. Dataflow applications are represented by reusable dataflow graphs called map components, while the executable version is called a prepared map. Using runtime properties the prepared map is executed in parallel with a thread allocated to each map process. The execution environment not only monitors threads, detects and corrects deadlocks, logs and controls program exceptions, but also data input and output ports of the map components are processed in parallel to take advantage of data partitioning schemes. Port implementation supports multi-state null value tokens to more accurately report exceptions. Data tokens are batched to minimize synchronization and transportation overhead and thread contention.

    摘要翻译: 执行环境提供可扩展性,其中组件将并行执行并利用各种并行模式。 数据流应用程序由称为映射组件的可重用数据流图表示,而可执行版本称为准备映射。 使用运行时属性,准备的映射与分配给每个映射过程的线程并行执行。 执行环境不仅监视线程,检测和纠正死锁,记录和控制程序异常,还可以并行处理地图组件的数据输入和输出端口,以利用数据分区方案。 端口实现支持多状态空值令牌以更准确地报告异常。 批量数据令牌以最小化同步和传输开销和线程争用。

    System and method for data transformation using dataflow graphs
    5.
    发明授权
    System and method for data transformation using dataflow graphs 有权
    使用数据流图进行数据转换的系统和方法

    公开(公告)号:US08429631B2

    公开(公告)日:2013-04-23

    申请号:US12881504

    申请日:2010-09-14

    IPC分类号: G06F9/44 G06F9/45

    CPC分类号: G06F9/524 G06F8/10 G06F8/34

    摘要: A system and method for managing data, such as in a data warehousing, analysis, or similar applications, where dataflow graphs are expressed as reusable map components, at least some of which are selected from a library of components, and map components are assembled to create an integrated dataflow application. Composite map components encapsulate a dataflow pattern using other maps as subcomponents. Ports are used as link points to assemble map components and are hierarchical and composite allowing ports to contain other ports. The dataflow application may be executed in a parallel processing environment by recognizing the linked data processes within the map components and assigning threads to the linked data processes.

    摘要翻译: 一种用于管理数据的系统和方法,例如在数据仓库,分析或类似应用中,其中数据流图被表示为可重用地图分量,其中至少一些从组件库中选择,并且映射组件被组合到 创建一个集成的数据流应用程序。 复合地图组件使用其他地图作为子组件来封装数据流模式。 端口用作组合映射组件的链接点,并且是分层和复合的,允许端口包含其他端口。 可以在并行处理环境中通过识别地图组件内的链接的数据处理并将线程分配给链接的数据处理来执行数据流应用。

    System and Method for Data Transformation using Dataflow Graphs
    6.
    发明申请
    System and Method for Data Transformation using Dataflow Graphs 有权
    使用数据流图进行数据转换的系统和方法

    公开(公告)号:US20110004880A1

    公开(公告)日:2011-01-06

    申请号:US12881504

    申请日:2010-09-14

    CPC分类号: G06F9/524 G06F8/10 G06F8/34

    摘要: A system and method for managing data, such as in a data warehousing, analysis, or similar applications, where dataflow graphs are expressed as reusable map components, at least some of which are selected from a library of components, and map components are assembled to create an integrated dataflow application. Composite map components encapsulate a dataflow pattern using other maps as subcomponents. Ports are used as link points to assemble map components and are hierarchical and composite allowing ports to contain other ports. The dataflow application may be executed in a parallel processing environment by recognizing the linked data processes within the map components and assigning threads to the linked data processes.

    摘要翻译: 一种用于管理数据的系统和方法,例如在数据仓库,分析或类似应用中,其中数据流图被表示为可重用地图分量,其中至少一些从组件库中选择,并且映射组件被组合到 创建一个集成的数据流应用程序。 复合地图组件使用其他地图作为子组件来封装数据流模式。 端口用作组合映射组件的链接点,并且是分层和复合的,允许端口包含其他端口。 可以在并行处理环境中通过识别地图组件内的链接的数据处理并将线程分配给链接的数据处理来执行数据流应用。

    System and method for data transformation using dataflow graphs
    7.
    发明授权
    System and method for data transformation using dataflow graphs 有权
    使用数据流图进行数据转换的系统和方法

    公开(公告)号:US07840949B2

    公开(公告)日:2010-11-23

    申请号:US10700254

    申请日:2003-11-03

    CPC分类号: G06F9/524 G06F8/10 G06F8/34

    摘要: A system and method for managing data, such as in a data warehousing, analysis, or similar applications, where dataflow graphs are expressed as reusable map components, at least some of which are selected from a library of components, and map components are assembled to create an integrated dataflow application. Composite map components encapsulate a dataflow pattern using other maps as subcomponents. Ports are used as link points to assemble map components and are hierarchical and composite allowing ports to contain other ports. The dataflow application may be executed in a parallel processing environment by recognizing the linked data processes within the map components and assigning threads to the linked data processes.

    摘要翻译: 一种用于管理数据的系统和方法,例如在数据仓库,分析或类似应用中,其中数据流图被表示为可重用地图分量,其中至少一些从组件库中选择,并且映射组件被组合到 创建一个集成的数据流应用程序。 复合地图组件使用其他地图作为子组件来封装数据流模式。 端口用作组合映射组件的链接点,并且是分层和复合的,允许端口包含其他端口。 可以在并行处理环境中通过识别地图组件内的链接的数据处理并将线程分配给链接的数据处理来执行数据流应用。

    Data transformation system, graphical mapping tool, and method for creating a schema map
    8.
    发明授权
    Data transformation system, graphical mapping tool, and method for creating a schema map 有权
    数据转换系统,图形绘图工具和创建模式图的方法

    公开(公告)号:US09201558B1

    公开(公告)日:2015-12-01

    申请号:US13288380

    申请日:2011-11-03

    摘要: Graphical mapping interface embodiments and method are provided for creating and displaying a schema map, which may be used by a data transformation system to perform a data transformation between at least one source schema and at least one target schema. According to one embodiment, the graphical mapping interface may comprise a source schema region for displaying a graphical representation of at least one source schema, a target schema region for displaying a graphical representation of at least one target schema, and a mapping region for displaying graphical representations of a plurality of links connecting the source nodes displayed in the source schema region to the target nodes displayed in the target schema region. The plurality of links may comprise at least one control link having at least one ECA rule associated therewith and at least one data link having at least one textual-based target field expression associated therewith.

    摘要翻译: 提供了用于创建和显示模式图的图形映射界面实施例和方法,模式映射可由数据变换系统用于在至少一个源模式和至少一个目标模式之间执行数据转换。 根据一个实施例,图形映射界面可以包括用于显示至少一个源模式的图形表示的源模式区域,用于显示至少一个目标模式的图形表示的目标模式区域,以及用于显示图形的映射区域 将在源模式区域中显示的源节点连接到在目标模式区域中显示的目标节点的多个链接的表示。 多个链路可以包括至少一个具有与其相关联的至少一个ECA规则的控制链路和至少一个具有与其相关联的至少一个基于文本的目标字段表达的数据链路。

    Modeless event-driven data transformation
    9.
    发明授权
    Modeless event-driven data transformation 有权
    无事件驱动的数据转换

    公开(公告)号:US06820135B1

    公开(公告)日:2004-11-16

    申请号:US09974747

    申请日:2001-10-10

    IPC分类号: G06F1516

    摘要: A system and method is described for event-driven data transformation. Generally, the system and method is directed to a transformation engine that iterates through one or more data sources, transforms data received from the data sources, and stores the output to one or more data targets. More specifically, the transformation engine is driven by executing specified event actions upon occurrence of specified triggering events. Thus, flexible, adaptable, highly tailored transformations can be implemented without incurring the often substantial expense of developing customized point-to-point solutions from scratch. The present invention supports one-to-one mappings, many-to-one mappings, one-to-many mappings, and many-to-many mappings. In addition, the present invention supports both hierarchical and flat data sources and targets.

    摘要翻译: 描述了一种用于事件驱动的数据转换的系统和方法。 通常,系统和方法被引导到转换引擎,其遍历一个或多个数据源,转换从数据源接收的数据,并将输出存储到一个或多个数据目标。 更具体地,通过在发生指定的触发事件时执行指定的事件动作来驱动变换引擎。 因此,可以实现灵活,适应性强,高度定制的转换,而不会导致从零开始开发定制点对点解决方案所需的大量费用。 本发明支持一对一映射,多对一映射,一对多映射和多对多映射。 此外,本发明支持分层和平坦的数据源和目标。

    System and method for event-driven data transformation
    10.
    发明授权
    System and method for event-driven data transformation 有权
    用于事件驱动数据转换的系统和方法

    公开(公告)号:US06795868B1

    公开(公告)日:2004-09-21

    申请号:US09652473

    申请日:2000-08-31

    IPC分类号: G06F1516

    摘要: A system and method is described for event-driven data transformation. Generally, the system and method is directed to a transformation engine that iterates through one or more data sources, transforms data received from the data sources, and stores the output to one or more data targets. More specifically, the transformation engine is driven by executing specified event actions upon occurrence of specified triggering events. Thus, flexible, adaptable, highly tailored transformations can be implemented without incurring the often substantial expense of developing customized point-to-point solutions from scratch. The present invention supports one-to-one, mappings, many-to-one mappings, one-to-many mappings, and many-to-many mappings. In addition, the present invention supports both hierarchical and flat data sources and targets.

    摘要翻译: 描述了一种用于事件驱动的数据转换的系统和方法。 通常,系统和方法被引导到转换引擎,其遍历一个或多个数据源,转换从数据源接收的数据,并将输出存储到一个或多个数据目标。 更具体地,通过在发生指定的触发事件时执行指定的事件动作来驱动变换引擎。 因此,可以实现灵活,适应性强,高度定制的转换,而不会导致从零开始开发定制点对点解决方案所需的大量费用。 本发明支持一对一,映射,多对一映射,一对多映射和多对多映射。 此外,本发明支持分层和平坦的数据源和目标。