Data ingestion to avoid congestion in NoSQL databases

    公开(公告)号:US11966387B2

    公开(公告)日:2024-04-23

    申请号:US17933635

    申请日:2022-09-20

    CPC classification number: G06F16/2379

    Abstract: Method, computer program product, and computer system are provided. Traffic is collected against a NoSQL database by an activity collector. A database transaction log is periodically extracted and analyzed. The collected traffic and the analyzed database transaction log are input to building a knowledge base of database access patterns. Current traffic is captured and used to compute an activity threshold. Traffic is directed to a workload processor based on the activity threshold. Traffic is directed to an intensive insert/update/delete (IUD) processor in response to the activity threshold exceeding a configured threshold. A plurality of temporary shards is generated along with an adaptive key and adaptive index in the plurality of temporary shards. The intensive IUD processor traffic is re-directed to the plurality of temporary shards while the activity threshold exceeds the configured threshold.

    DATA INGESTION TO AVOID CONGESTION IN NOSQL DATABASES

    公开(公告)号:US20240095234A1

    公开(公告)日:2024-03-21

    申请号:US17933635

    申请日:2022-09-20

    CPC classification number: G06F16/2379

    Abstract: Method, computer program product, and computer system are provided. Traffic is collected against a NoSQL database by an activity collector. A database transaction log is periodically extracted and analyzed. The collected traffic and the analyzed database transaction log are input to building a knowledge base of database access patterns. Current traffic is captured and used to compute an activity threshold. Traffic is directed to a workload processor based on the activity threshold. Traffic is directed to an intensive insert/update/delete (IUD) processor in response to the activity threshold exceeding a configured threshold. A plurality of temporary shards is generated along with an adaptive key and adaptive index in the plurality of temporary shards. The intensive IUD processor traffic is re-directed to the plurality of temporary shards while the activity threshold exceeds the configured threshold.

    DATABASE REPLICATION USING ADAPTIVE COMPRESSION

    公开(公告)号:US20230022619A1

    公开(公告)日:2023-01-26

    申请号:US17377431

    申请日:2021-07-16

    Abstract: Methods, computer program products, and/or systems are provided that perform the following operations: in a data replication environment, analyzing a database workload to generate a knowledge base of information related to compression; dividing a transfer data stream into different segments based, at least in part, on the knowledge base; obtaining candidate compression types for the transfer data stream based, at least in part, on the knowledge base; assigning respective compression types of the candidate compression types to the different segments; generating compressed segments based, at least in part, on the respective compression types assigned to the different segments; and providing the compressed segments to a replication target.

Patent Agency Ranking