Data ingestion by distributed-computing systems

    公开(公告)号:US11144570B2

    公开(公告)日:2021-10-12

    申请号:US15881396

    申请日:2018-01-26

    Applicant: VMware, Inc.

    Abstract: Techniques for data ingestion by a distributed-computing system are provided. In one embodiment, data received from one or more data sources is processed at a management node of the distributed-computing system. The data is generated by one or more components of an information processing system external to the distributed-computing system. The data is stored at the management plane. The management plane selects, from a plurality of data cores, a data core to ingest the data. The plurality of data cores are stored across one or more data plane containers of a data plane of the distributed-computing system. The management plane processes the data to generate one or more event records corresponding to the data. The one or more event records are sent to the selected data core, which causes the data plane to store the one or more event records in the selected data core.

    MULTI-TENANT RATE LIMITING SERVICE FOR DISTRIBUTED SYSTEMS

    公开(公告)号:US20250030699A1

    公开(公告)日:2025-01-23

    申请号:US18376007

    申请日:2023-10-03

    Applicant: VMWARE, Inc.

    Abstract: The disclosure provides a method for configuring rate limiting policies for microservices in a request execution chain of a distributed system. The method generally includes receiving global rate limit(s), where each global rate limit is associated with a tag and a microservice of a plurality of microservices, and each global rate limit indicates a rate of requests tagged with the tag associated with the global rate limit allowed to be processed by the microservice associated with the global rate limit; and configuring, for each global rate limit: each of the local rate limiter(s) associated with microservice instance(s) associated with the global rate limit with a local rate limit indicating a rate of requests tagged with the tag associated with the global rate limit allowed to be processed by the microservice instance, wherein the local rate limit of each of the local rate limiter(s) is based on the global rate limit.

    Secure multi-directional data pipeline for data distribution systems

    公开(公告)号:US11848981B2

    公开(公告)日:2023-12-19

    申请号:US17322817

    申请日:2021-05-17

    Applicant: VMware, Inc.

    CPC classification number: H04L67/10 H04L45/38 H04L67/63 H04L12/66

    Abstract: Techniques for ingesting data streams to a distributed-computing system using a multi-directional data ingestion pipeline are provided. In one embodiment, a method for ingesting data streams includes, at a client gateway, receiving a plurality of messages; assigning the plurality of messages to one or more data streams; obtaining stream routing configurations; and identifying one or more receivers. The method further includes determining whether at least one of the one or more data streams is to be delivered to one or more receivers operating in the first computing environment; and if so, delivering the at least one of the one or more data streams to the one or more receivers operating in the first computing environment. The method further includes delivering the one or more data streams to a data ingress gateway operating in a second computing environment.

    Alert notification on streaming textual data

    公开(公告)号:US11693717B2

    公开(公告)日:2023-07-04

    申请号:US17549310

    申请日:2021-12-13

    Applicant: VMware, Inc.

    CPC classification number: G06F9/542 G06F9/4837 G06F9/546 G06F16/1734

    Abstract: In a computer-implemented method for performing alert notification on streaming textual data, streaming textual data is received. A plurality of copies of the streaming textual data is generated, wherein a first copy of the streaming textual data is transmitted to an ingestion service for persistent storage at a data plane and a second copy of the streaming textual data is transmitted to an alert evaluation service for performing alert evaluation on the streaming textual data, such that the ingestion service and the alert evaluation service are performed independently. The streaming textual data is evaluated by the alert evaluation service to detect an alert. Responsive to detecting an alert at the alert evaluation service, a notification of the alert is generated.

    Splitting a query into native query operations and post-processing operations

    公开(公告)号:US11514032B2

    公开(公告)日:2022-11-29

    申请号:US17113478

    申请日:2020-12-07

    Applicant: VMware, Inc.

    Abstract: Techniques for splitting a query into native query operations and post-processing operations are provided. In one embodiment, a user query including a plurality of search parameters is received. Expressions representing the plurality of search parameters in the user query are determined. A first subset and a second subset of the expressions are identified. Each expression of the first subset corresponds to one of a plurality of native query operations executable by a database platform, and each expression of the second subset corresponds to one of a plurality of predefined post-processing operations not executable by the database platform. A database query is generated based on one or more expressions of the first subset, and a post-processing query is generated based on each expression in the second subset. The database query is executed by the database platform, then the post-processing query is executed on the results from database platform.

    ALERT NOTIFICATION ON STREAMING TEXTUAL DATA

    公开(公告)号:US20220100589A1

    公开(公告)日:2022-03-31

    申请号:US17549310

    申请日:2021-12-13

    Applicant: VMware, Inc.

    Abstract: In a computer-implemented method for performing alert notification on streaming textual data, streaming textual data is received. A plurality of copies of the streaming textual data is generated, wherein a first copy of the streaming textual data is transmitted to an ingestion service for persistent storage at a data plane and a second copy of the streaming textual data is transmitted to an alert evaluation service for performing alert evaluation on the streaming textual data, such that the ingestion service and the alert evaluation service are performed independently. The streaming textual data is evaluated by the alert evaluation service to detect an alert. Responsive to detecting an alert at the alert evaluation service, a notification of the alert is generated.

    Splitting a time-range query into multiple sub-queries for serial execution

    公开(公告)号:US11016972B2

    公开(公告)日:2021-05-25

    申请号:US15881382

    申请日:2018-01-26

    Applicant: VMware, Inc.

    Abstract: Techniques for splitting a time-range query into sub-queries for serial execution are provided. In one embodiment, a user query is received requesting items within a time range from a database. The time range is divided into a plurality of time periods within the time range. Sub-queries defining respective time periods of the plurality of time periods are generated from the user query, and a first sub-query is executed. The first sub-query defines a first time period of the plurality of time periods, where the first time period is a most-recent time period or a least-recent time period among the plurality of time periods. If it is determined that a number of items obtained from executing the first sub-query is greater than or equal to a predetermined result target, then the items obtained from executing the first sub-query are provided and subsequent sub-queries are not executed.

Patent Agency Ranking