-
公开(公告)号:US11650858B2
公开(公告)日:2023-05-16
申请号:US17031086
申请日:2020-09-24
IPC分类号: G06F9/50 , G06F16/23 , G06F9/48 , G06Q10/0631
CPC分类号: G06F9/5083 , G06F9/4881 , G06F16/2379 , G06Q10/06312
摘要: A method for maintaining version consistency of resources. The method provides for one or more processors to receive a submitted request to run a job in which the job includes a processing element and a timestamp associated with running the job. Identification of a resource type associated with the processing element is determined, based on a tag included in the job, associated with the processing element. A version of the resource type of the processing element is determined, based on a mapping of the tag associated with the identified resource type and the timestamp of the job. The resource type of the determined version is requested from a resource manager, and responsive to a confirmation of assigning the version of the resource type from the resource manager, the process element of the job is performed on the version of the resource type assigned by the resource manager.
-
公开(公告)号:US11500877B2
公开(公告)日:2022-11-15
申请号:US16702235
申请日:2019-12-03
发明人: Rafal Konik , Jingdong Sun , Roger Mittelstadt , Jessica R. Eidem
IPC分类号: G06F16/00 , G06F16/2455 , G06F16/25 , G06F16/2453 , G06F16/22
摘要: In an embodiment, a method for controlling a database in a streaming application includes receiving, by a compute node, data for transmission as streaming data on a network connected to the compute node and a database. The compute node then assembles a body portion of a tuple to include the data and assembles a header portion of the tuple to include a database statement that identifies a change to be made by the database to an aspect of the database in a format that is identifiable by the database. The compute node then transmits the tuple having the header portion thereof and the body portion thereof on the network as streaming data with the header and body portions of the tuple being directed to the database.
-
公开(公告)号:US20220091904A1
公开(公告)日:2022-03-24
申请号:US17031086
申请日:2020-09-24
摘要: A method for maintaining version consistency of resources. The method provides for one or more processors to receive a submitted request to run a job in which the job includes a processing element and a timestamp associated with running the job. Identification of a resource type associated with the processing element is determined, based on a tag included in the job, associated with the processing element. A version of the resource type of the processing element is determined, based on a mapping of the tag associated with the identified resource type and the timestamp of the job. The resource type of the determined version is requested from a resource manager, and responsive to a confirmation of assigning the version of the resource type from the resource manager, the process element of the job is performed on the version of the resource type assigned by the resource manager.
-
公开(公告)号:US09967160B2
公开(公告)日:2018-05-08
申请号:US14718370
申请日:2015-05-21
发明人: Bin Cao , Jessica R. Eidem , Brian R. Muras , Jingdong Sun
CPC分类号: H04L43/045 , G06F9/455 , G06F17/30516 , H04L41/5019 , H04L43/026 , H04L43/16 , H04L65/40 , H04L65/80
摘要: A streams manager monitors performance of a streaming application and determines if operators are underperforming according to a threshold. When the performance needs to be improved, the streams manager automatically modifies the flow graph to offload or reroute a stream of data, or part of a stream of data, to a similar operator to more efficiently utilize streaming resources. Operators are provided with multiple ports to allow the streams manager to send additional streams to the operator.
-
公开(公告)号:US20160344784A1
公开(公告)日:2016-11-24
申请号:US14740776
申请日:2015-06-16
发明人: Bin Cao , Jessica R. Eidem , Brian R. Muras , Jingdong Sun
CPC分类号: H04L43/045 , G06F9/455 , G06F17/30516 , H04L41/5019 , H04L43/026 , H04L43/16 , H04L65/40 , H04L65/80
摘要: A streams manager monitors performance of a streaming application and determines if operators are underperforming according to a threshold. When the performance needs to be improved, the streams manager automatically modifies the flow graph to offload or reroute a stream of data, or part of a stream of data, to a similar operator to more efficiently utilize streaming resources. Operators are provided with multiple ports to allow the streams manager to send additional streams to the operator.
摘要翻译: 流管理器监视流应用的性能,并根据阈值确定操作者是否表现不佳。 当性能需要改进时,流管理器自动修改流图,以将数据流或数据流的一部分重新路由到类似的运算符以更有效地利用流资源。 操作员具有多个端口,以允许流管理器向操作员发送附加流。
-
公开(公告)号:US20150127671A1
公开(公告)日:2015-05-07
申请号:US14069688
申请日:2013-11-01
发明人: Bin Cao , Jessica R. Eidem , Brian R. Muras , Jingdong Sun
IPC分类号: G06F17/30
CPC分类号: G06F17/30958 , G06F9/45533 , G06F9/5066 , G06F17/30516
摘要: Embodiments of the disclosure provide a method, system, and computer program product for managing a template on an operator graph. The method for managing a template on an operator graph can include receiving the template for processing a stream of tuples. The template can have a plurality of template elements operating on one or more computer processors. The method can include calculating a resource requirement of a template element from the template. The method can include calculating a resource availability of a virtual machine. The method can include allocating the template onto the operator graph. The operator graph can have a plurality of processing elements operating on one or more computer processors. The method can also include mapping the template element from the template onto the virtual machine as a function of the resource requirement of the template element and the resource availability of the virtual machine.
摘要翻译: 本公开的实施例提供了一种用于在运营商图上管理模板的方法,系统和计算机程序产品。 用于在运算符图上管理模板的方法可以包括接收用于处理元组流的模板。 模板可以具有在一个或多个计算机处理器上操作的多个模板元素。 该方法可以包括从模板计算模板元素的资源需求。 该方法可以包括计算虚拟机的资源可用性。 该方法可以包括将模板分配到运算符图上。 操作员图可以具有在一个或多个计算机处理器上操作的多个处理元件。 该方法还可以包括将模板元素从模板映射到虚拟机上,作为模板元素的资源需求和虚拟机的资源可用性的函数。
-
公开(公告)号:US11687380B2
公开(公告)日:2023-06-27
申请号:US17016508
申请日:2020-09-10
IPC分类号: G06F9/50 , G06N20/00 , G06F9/48 , G06F18/214
CPC分类号: G06F9/5077 , G06F9/4881 , G06F9/50 , G06F9/5061 , G06F18/214 , G06N20/00
摘要: Computer software executing on computer hardware that performs the following operations: (i) training a machine learning model to determine allocations of computing resources to processing elements of a stream processing job according to a specified objective; and (ii) allocating a set of computing resources to the processing elements by: allocating to the processing elements a first subset of the set of computing resources based, at least in part, on a minimum resource requirement for the processing elements, and allocating to the processing elements a second subset of the set of computing resources based, at least in part, on an allocation determined using the trained machine learning model.
-
公开(公告)号:US11558473B2
公开(公告)日:2023-01-17
申请号:US17124854
申请日:2020-12-17
IPC分类号: H04L67/00 , H04L67/025 , G06F11/30 , H04L43/0817
摘要: A stream of tuples to be processed by processing elements that operate on one or more compute nodes of a stream application is monitored. Each processing element has one or more stream operators. A program request to execute a set of program code instructions is received. A stream application target of the set of program code instructions is identified based on the program request. A portion of the stream application is encapsulated with a generic program execution structure during operation of the stream application. The structure is configured to receive and execute program code instructions outside of a preconfigured operation of the stream application. The set of program code instructions is executed by the structure during operation of the stream application, at a time period of execution of the portion, in response to the program request, and based on the stream application target.
-
公开(公告)号:US20220012248A1
公开(公告)日:2022-01-13
申请号:US16923523
申请日:2020-07-08
IPC分类号: G06F16/2455 , G06F16/28 , G06F16/22 , G06F16/242
摘要: A stream of tuples is monitored. The stream of tuples is to be processed by a plurality of processing elements of a stream application that operate on one or more compute nodes, each processing element having one or more stream operators. A processing rate of a first stream operator of the stream application is calculated. The processing rate is based on the number of tuples that are processed by the first stream operator. It is determined that the processing rate of the first stream operator meets a predetermined tuple processing criterion. The processing rate of the first stream operator is adjusted based on the predetermined tuple processing criterion.
-
公开(公告)号:US11204926B2
公开(公告)日:2021-12-21
申请号:US16177260
申请日:2018-10-31
IPC分类号: G06F17/30 , G06F16/2455 , G06F16/23 , G06F16/25 , G06F16/22
摘要: A tuple manager of a database system processes partial tuples from a streaming application and stores them in a database. The partial tuples may include a large object (LOB) that arrives at the database at a different time than the rest of the corresponding tuple. A tuple manager stores partial tuples and uses a partial tuples index to track the partial tuples and coordinate recombination of corresponding partial tuples. The database allows queries to be run on the partial data before the tuples are reconstructed allowing faster access to potentially important data before the arrival and processing of a partial tuple such as an LOB.
-
-
-
-
-
-
-
-
-