-
1.
公开(公告)号:US09542461B2
公开(公告)日:2017-01-10
申请号:US13624273
申请日:2012-09-21
IPC分类号: G06F17/30
CPC分类号: G06F17/30563
摘要: A computer receives one or more files having configuration information that includes data that defines a plurality of stages of an extract, transform, and load (ETL) job, wherein the plurality of stages comprise a read stage that is preceded by a write stage, and wherein the read stage reads data from a source location, and wherein the data that is read or a modified version of the data that is read is being written by the write stage that writes data to the source location. The computer replaces the read stage with a decompressor stage. The computer replaces the write stage with a compressor stage. The computer executes the decompressor stage and compressor stage on a field-programmable gate array that is programmatically customized with data compression and data decompression functionality to enhance the performance of the ETL job.
摘要翻译: 计算机接收具有配置信息的一个或多个文件,该配置信息包括定义提取,变换和加载(ETL)作业的多个阶段的数据,其中所述多个阶段包括在写入阶段之前的读取阶段,以及 其中所述读取阶段从源位置读取数据,并且其中所读取的数据或所读取的数据的修改版本正由写入数据写入所述源位置的写入阶段写入。 计算机用解压缩器阶段替换读取阶段。 计算机用压缩机级代替写入级。 计算机在现场可编程门阵列上执行解压缩级和压缩级,可通过数据压缩和数据解压缩功能编程定制,以增强ETL作业的性能。
-
2.
公开(公告)号:US20140089252A1
公开(公告)日:2014-03-27
申请号:US13895392
申请日:2013-05-16
IPC分类号: G06F17/30
CPC分类号: G06F17/30563
摘要: A computer receives one or more files having configuration information that includes data that defines a plurality of stages of an extract, transform, and load (ETL) job, wherein the plurality of stages comprise a read stage that is preceded by a write stage, and wherein the read stage reads data from a source location, and wherein the data that is read or a modified version of the data that is read is being written by the write stage that writes data to the source location. The computer replaces the read stage with a decompressor stage. The computer replaces the write stage with a compressor stage. The computer executes the decompressor stage and compressor stage on a field-programmable gate array that is programmatically customized with data compression and data decompression functionality to enhance the performance of the ETL job.
摘要翻译: 计算机接收具有配置信息的一个或多个文件,该配置信息包括定义提取,变换和加载(ETL)作业的多个阶段的数据,其中所述多个阶段包括在写入阶段之前的读取阶段,以及 其中所述读取阶段从源位置读取数据,并且其中所读取的数据或所读取的数据的修改版本正由写入数据写入所述源位置的写入阶段写入。 计算机用解压缩器阶段替换读取阶段。 计算机用压缩机级代替写入级。 计算机在现场可编程门阵列上执行解压缩级和压缩级,可通过数据压缩和数据解压缩功能编程定制,以增强ETL作业的性能。
-
公开(公告)号:US20140089251A1
公开(公告)日:2014-03-27
申请号:US13624273
申请日:2012-09-21
IPC分类号: G06F17/30
CPC分类号: G06F17/30563
摘要: A computer receives one or more files having configuration information that includes data that defines a plurality of stages of an extract, transform, and load (ETL) job, wherein the plurality of stages comprise a read stage that is preceded by a write stage, and wherein the read stage reads data from a source location, and wherein the data that is read or a modified version of the data that is read is being written by the write stage that writes data to the source location. The computer replaces the read stage with a decompressor stage. The computer replaces the write stage with a compressor stage. The computer executes the decompressor stage and compressor stage on a field-programmable gate array that is programmatically customized with data compression and data decompression functionality to enhance the performance of the ETL job.
-
公开(公告)号:US10262049B2
公开(公告)日:2019-04-16
申请号:US15190223
申请日:2016-06-23
摘要: Performing an extract, transform, and load (ETL) process. Column data is received by a stage of the ETL process. The size of the received column data is ascertained by the stage. In response to determining that the size of the column data exceeds a predefined threshold, the stage saves the column data and creates a data locator associated with the column data. The created data locator advances through successive downstream stages of the ETL process as a replacement for the column data.
-
公开(公告)号:US10216816B2
公开(公告)日:2019-02-26
申请号:US15987450
申请日:2018-05-23
摘要: Performing an extract, transform, and load (ETL) process. Column data is received by a stage of the ETL process. The size of the received column data is ascertained by the stage. In response to determining that the size of the column data exceeds a predefined threshold, the stage saves the column data and creates a data locator associated with the column data. The created data locator advances through successive downstream stages of the ETL process as a replacement for the column data.
-
公开(公告)号:US20180288134A1
公开(公告)日:2018-10-04
申请号:US15478471
申请日:2017-04-04
IPC分类号: H04L29/08 , H04L12/24 , H04L12/911
摘要: Disclosed aspects relate to data integration application execution management using both a set of managed nodes and a set of unmanaged nodes. An execution request for a data integration application may be sensed. A first set of commands of the data integration application may be assigned to the set of managed nodes. A second set of commands of the data integration application may be assigned to the set of unmanaged nodes. Execution of the data integration application may be initiated using the set of managed nodes to process the first set of commands and the set of unmanaged nodes to process the second set of commands.
-
公开(公告)号:US09679033B2
公开(公告)日:2017-06-13
申请号:US14221834
申请日:2014-03-21
CPC分类号: G06F17/30563
摘要: Insertion, in a data warehouse process, of a buffer operator between an upstream data operator and a downstream data operator. The processor processes a data record for the upstream data operator to pass to the downstream data operator. In response to determining that the downstream data operator is not ready to accept the data record from the upstream data operator, a buffer operator is inserted between the upstream data operator and the downstream data operator. The data record processed by the upstream data operator is passed to the buffer operator for storing into a buffer allocated for use by the buffer operator. The data record stored into the buffer is passed to the downstream data operator when the downstream data operator is ready to accept data. In another aspect, when the allocated buffer utilization decreases to a threshold value, the buffer operator is removed and the buffers are released.
-
8.
公开(公告)号:US09529873B2
公开(公告)日:2016-12-27
申请号:US13895392
申请日:2013-05-16
IPC分类号: G06F17/30
CPC分类号: G06F17/30563
摘要: A computer receives one or more files having configuration information that includes data that defines a plurality of stages of an extract, transform, and load (ETL) job, wherein the plurality of stages comprise a read stage that is preceded by a write stage, and wherein the read stage reads data from a source location, and wherein the data that is read or a modified version of the data that is read is being written by the write stage that writes data to the source location. The computer replaces the read stage with a decompressor stage. The computer replaces the write stage with a compressor stage. The computer executes the decompressor stage and compressor stage on a field-programmable gate array that is programmatically customized with data compression and data decompression functionality to enhance the performance of the ETL job.
摘要翻译: 计算机接收具有配置信息的一个或多个文件,该配置信息包括定义提取,变换和加载(ETL)作业的多个阶段的数据,其中所述多个阶段包括在写入阶段之前的读取阶段,以及 其中所述读取阶段从源位置读取数据,并且其中所读取的数据或所读取的数据的修改版本正由写入数据写入所述源位置的写入阶段写入。 计算机用解压缩器阶段替换读取阶段。 计算机用压缩机级代替写入级。 计算机在现场可编程门阵列上执行解压缩级和压缩级,可通过数据压缩和数据解压缩功能编程定制,以增强ETL作业的性能。
-
公开(公告)号:US10552492B2
公开(公告)日:2020-02-04
申请号:US14606077
申请日:2015-01-27
IPC分类号: G06F16/951 , G06F16/245 , H04L12/58
摘要: A discussion thread is associated with a master recipients list that is maintained at an author's computer or a server computer. The recipients list is revised as participants in the discussion are added to and/or removed from the discussion. An author is notified when target recipients do not match the master recipients list. When a participant is added to the discussion from an old discussion instance, a thread manager provides for the added participant to receive a more current discussion instance.
-
公开(公告)号:US09787761B2
公开(公告)日:2017-10-10
申请号:US14500896
申请日:2014-09-29
发明人: Krishna K. Bonagiri , Eric A. Jacobson , Yong Li , Xiaoyan Pu
IPC分类号: G06F15/173 , H04L29/08 , G06F9/50
CPC分类号: H04L67/10 , G06F9/5066
摘要: Provided are a computer program product, system, and method for allocating physical nodes for processes in an execution plan. An execution plan is generated indicating a plurality of processes. A resource requirement is generated indicating requested physical nodes and an assignment of the processes to execute on the requested physical nodes. A determination is made from the resource requirement of a resource allocation of physical nodes for the requested physical nodes and the processes. The execution plan is updated to generate an updated execution plan indicating the physical nodes on which the processes will execute according to the received resource allocation.
-
-
-
-
-
-
-
-
-