Automated configuration based deployment of stream processing pipeline

    公开(公告)号:US11178213B2

    公开(公告)日:2021-11-16

    申请号:US15908690

    申请日:2018-02-28

    Applicant: VMware Inc.

    Abstract: Techniques for generating a stream processing pipeline are provided. In one embodiment, a method includes receiving a configuration file from a data service. The configuration file represents a pipeline configuration of the stream processing pipeline, and the pipeline configuration includes representations of a plurality of different types of pipeline stages configured based on a respective customization of an entity. The method further includes generating a plurality of pipeline stages in accordance with the pipeline configuration of the stream processing pipeline; collecting, at one or more pipeline stages of a first-type in the stream processing pipeline, data items from one or more data sources; processing the collected data items at one or more pipeline stages of a second-type in the stream processing pipeline; and transmitting, at one or more pipeline stages of a third-type in the stream processing pipeline, the processed data items to the data service.

    NODE SELECTION FOR MESSAGE REDISTRIBUTION IN AN INTEGRATED APPLICATION-AWARE LOAD BALANCER INCORPORATED WITHIN A DISTRIBUTED-SERVICE-APPLICATION-CONTROLLED DISTRIBUTED COMPUTER SYSTEM

    公开(公告)号:US20170214738A1

    公开(公告)日:2017-07-27

    申请号:US15005922

    申请日:2016-01-25

    Applicant: VMware, Inc.

    CPC classification number: H04L67/1002 H04L47/125 H04L69/326 H04L69/329

    Abstract: The current document is directed to an integrated application-aware load-balancing component of a distributed computer system. The integrated application-aware load-balancing component is, in a described embodiment, incorporated within a distributed application that serves as a control component of multiple physical computers within a distributed computer system. The integrated application-aware load-balancing component includes a layer-4 load-balancing subcomponent that distributes communications connections initiated by remote client computers among computational nodes within the distributed computer system in order to balance the computational load applied to the distributed application and distributed computer system by the remote client computers. The integrated application-aware load-balancing component additionally includes a layer-7 load-balancing subcomponent that periodically and locally computes weights for each computational node and redistributes client requests according to the computed weights among cluster nodes within the distributed computer system in order to enhance balancing of the computational load applied to the distributed service application and distributed computer system by the remote client computers. Operation of the layer-4 and layer-7 load balancers are controlled and/or adjusted by rules and policies informed by performance and operational characteristics of the distributed service application and distributed computer system.

    Node selection for message redistribution in an integrated application-aware load balancer incorporated within a distributed-service-application-controlled distributed computer system

    公开(公告)号:US10320891B2

    公开(公告)日:2019-06-11

    申请号:US15005922

    申请日:2016-01-25

    Applicant: VMware, Inc.

    Abstract: The current document is directed to an integrated application-aware load-balancing component of a distributed computer system. The integrated application-aware load-balancing component is, in a described embodiment, incorporated within a distributed application that serves as a control component of multiple physical computers within a distributed computer system. The integrated application-aware load-balancing component includes a layer-4 load-balancing subcomponent that distributes communications connections initiated by remote client computers among computational nodes within the distributed computer system in order to balance the computational load applied to the distributed application and distributed computer system by the remote client computers. The integrated application-aware load-balancing component additionally includes a layer-7 load-balancing subcomponent that periodically and locally computes weights for each computational node and redistributes client requests according to the computed weights among cluster nodes within the distributed computer system in order to enhance balancing of the computational load applied to the distributed service application and distributed computer system by the remote client computers. Operation of the layer-4 and layer-7 load balancers are controlled and/or adjusted by rules and policies informed by performance and operational characteristics of the distributed service application and distributed computer system.

    EFFICIENT LOG-FILE-BASED QUERY PROCESSING
    4.
    发明申请

    公开(公告)号:US20190155953A1

    公开(公告)日:2019-05-23

    申请号:US15816434

    申请日:2017-11-17

    Applicant: VMware, Inc.

    Abstract: The current document is directed to systems, and methods incorporated within the systems, that execute queries against log-file entries. A monitoring subsystem within a distributed computer system uses query results during analysis of log-file entries in order to detect changes in the state of the distributed computer system, identify problems or potential problems, and predict and forecast system characteristics. Because of the large numbers of log-file-entry containers that may need to be opened and processed in order to execute a single query, and because opening and reading through the entries in a log-file-entry container is a computationally expensive and time-consuming operation, the currently disclosed systems employ event-type metadata associated with log-file-entry containers to avoid opening and reading through the log-file entries of log-file-entry containers that do not contain log-file entries with event types relevant to the query.

    Integrated application-aware load balancer incorporated within a distributed-service-application-controlled distributed computer system

    公开(公告)号:US10992739B2

    公开(公告)日:2021-04-27

    申请号:US15005806

    申请日:2016-01-25

    Applicant: VMware, Inc.

    Abstract: The current document is directed to an integrated application-aware load-balancing component of a distributed computer system. The integrated application-aware load-balancing component is, in a described embodiment, incorporated within a distributed application that serves as a control component of multiple physical computers within a distributed computer system. The integrated application-aware load-balancing component includes a layer-4 load-balancing subcomponent that distributes communications connections initiated by remote client computers among computational nodes within the distributed computer system in order to balance the computational load applied to the distributed application and distributed computer system by the remote client computers. The integrated application-aware load-balancing component additionally includes a layer-7 load-balancing subcomponent that redistributes client requests among cluster nodes within the distributed computer system in order to enhance balancing of the computational load applied to the distributed application and distributed computer system by the remote client computers. Operation of the layer-4 and layer-7 load balancers are controlled and/or adjusted by rules and policies informed by performance and operational characteristics of the distributed application and distributed computer system.

    Methods and systems to sample event messages

    公开(公告)号:US11347373B2

    公开(公告)日:2022-05-31

    申请号:US15286366

    申请日:2016-10-05

    Applicant: VMware, Inc.

    Abstract: Methods and systems to sample event messages are described. As event messages are generated by one or more sources, the event messages are stored in a storage queue. An event message policy that represents conditions for storing event messages in a sample log file are input. For each event message output from the storage queue, the event message may be stored in a sample log file when one or more of the conditions of the event message policy are satisfied. The event messages of the sample log file may be displayed in a graphical user interface that enables a user to change the event message policy.

    Efficient log-file-based query processing

    公开(公告)号:US10776439B2

    公开(公告)日:2020-09-15

    申请号:US15816434

    申请日:2017-11-17

    Applicant: VMware, Inc.

    Abstract: The current document is directed to systems, and methods incorporated within the systems, that execute queries against log-file entries. A monitoring subsystem within a distributed computer system uses query results during analysis of log-file entries in order to detect changes in the state of the distributed computer system, identify problems or potential problems, and predict and forecast system characteristics. Because of the large numbers of log-file-entry containers that may need to be opened and processed in order to execute a single query, and because opening and reading through the entries in a log-file-entry container is a computationally expensive and time-consuming operation, the currently disclosed systems employ event-type metadata associated with log-file-entry containers to avoid opening and reading through the log-file entries of log-file-entry containers that do not contain log-file entries with event types relevant to the query.

Patent Agency Ranking