Automated configuration based deployment of stream processing pipeline

    公开(公告)号:US11178213B2

    公开(公告)日:2021-11-16

    申请号:US15908690

    申请日:2018-02-28

    Applicant: VMware Inc.

    Abstract: Techniques for generating a stream processing pipeline are provided. In one embodiment, a method includes receiving a configuration file from a data service. The configuration file represents a pipeline configuration of the stream processing pipeline, and the pipeline configuration includes representations of a plurality of different types of pipeline stages configured based on a respective customization of an entity. The method further includes generating a plurality of pipeline stages in accordance with the pipeline configuration of the stream processing pipeline; collecting, at one or more pipeline stages of a first-type in the stream processing pipeline, data items from one or more data sources; processing the collected data items at one or more pipeline stages of a second-type in the stream processing pipeline; and transmitting, at one or more pipeline stages of a third-type in the stream processing pipeline, the processed data items to the data service.

    Impartial buffering in stream processing

    公开(公告)号:US11190401B2

    公开(公告)日:2021-11-30

    申请号:US17074048

    申请日:2020-10-19

    Applicant: VMware Inc.

    Inventor: Deep P. Desai

    Abstract: Techniques for generating a stream processing pipeline are provided. In one embodiment, a method includes generating a plurality of pipeline stages of a stream processing pipeline in accordance with a configuration file. The plurality of pipeline stages includes a first processing stage designated for a first data service and a second processing stage designated for a second data service and operating in parallel to the first processing stage.

    Impartial buffering in stream processing

    公开(公告)号:US10812332B2

    公开(公告)日:2020-10-20

    申请号:US15908693

    申请日:2018-02-28

    Applicant: VMware Inc.

    Inventor: Deep P. Desai

    Abstract: Techniques for generating a stream processing pipeline are provided. In one embodiment, a method includes generating a plurality of pipeline stages of a stream processing pipeline in accordance with a configuration file. The plurality of pipeline stages includes a first buffer stage designated for a first data service and a second buffer stage designated for a second data service. The method further includes collecting data items; processing the collected data items; and storing at least a portion of the processed data items in the first buffer stage and at least a portion of the processed data items in the second buffer stage. The method further includes transmitting the data items stored in the first buffer stage to the first data service at a first transmission rate; and transmitting the data items stored in the second buffer stage to the second data service at a second transmission rate.

Patent Agency Ranking