Event-driven batch processing system with granular operational access

    公开(公告)号:US12111825B2

    公开(公告)日:2024-10-08

    申请号:US17984568

    申请日:2022-11-10

    CPC classification number: G06F16/2386 G06F16/2358 G06F16/26

    Abstract: Systems, computer program products, and methods are described herein for event-driven batch processing with granular operational access. The present disclosure is configured to retrieve, from one or more feature databases, one or more attributes to process one or more records associated with a first batch cycle; retrieve, from one or more configuration databases, one or more resources associated with the one or more records; generate a dashboard interface for the one or more records, wherein the dashboard interface comprises the one or more attributes, the one or more resources, and one or more operational access parameters associated with the processing of the one or more records; and provide, to a user input device associated with a user, the dashboard interface.

    Tuning external invocations utilizing weight-based parameter resampling

    公开(公告)号:US12099484B2

    公开(公告)日:2024-09-24

    申请号:US18510236

    申请日:2023-11-15

    Inventor: Debajyoti Roy

    CPC classification number: G06F16/215 G06F16/217 G06F16/2386 G06N20/00

    Abstract: Techniques are disclosed for tuning external invocations utilizing weight-based parameter resampling. In one example, a computer system determines a plurality of samples, each sample being associated with a parameter value of a plurality of potential parameter values of a particular parameter. The computer system assigns weights to each of the parameter values, and then selects a first sample for processing via a first external invocation based on a weight of the parameter value of the first sample. The computer system then determines feedback data associated with a level of performance of the first external invocation. The computer system adjusts the weights of the parameter values of the particular parameter based on the feedback data. The computer system then selects a second sample of the plurality of samples to be processed via execution of a second external invocation based on the adjustment of weights of the parameter values.

    Transmitting change data capture events during database replication

    公开(公告)号:US12079206B2

    公开(公告)日:2024-09-03

    申请号:US18091313

    申请日:2022-12-29

    CPC classification number: G06F16/2386 G06F16/273

    Abstract: An online system performs replication of database from one system to another. A source database is replicated to a target database by performing an initial bulk copy followed by repeated change data capture. The system performs batching to group events generated by the change data capture events. The system performs a multi-constrained analysis to determine when a batch is ready for sending. The system uses multiple buffers for transmitting events to decouple the receiving and sending of events. The online system may be a multi-tenant system the source and target databases stores data of tenants. The system determines a tenant score to adjust the resources allocated during event transfer. The system splits an event into partial events, to avoid dependency between the partial events so that tasks can be executed independent of each other. Therefore, the system performs replication with reduced synchronization overhead.

    Control mechanism of extract transfer and load (ETL) processes to improve memory usage

    公开(公告)号:US12026005B2

    公开(公告)日:2024-07-02

    申请号:US17968057

    申请日:2022-10-18

    Applicant: SAP SE

    CPC classification number: G06F16/254 G06F16/2358 G06F16/2386 G06F16/258

    Abstract: Embodiments are described for a data processing tool configured to cease operations of a plurality of database readers when detecting a congestion condition in the data processing tool. In some embodiments, the data processing tool comprises a memory, one or more processors, and a plurality of database readers. The one or more processors, coupled to the memory and the plurality of database readers are configured to determine a congestion condition in at least one data pipeline of a plurality of data pipelines of the data processing tool. Each data pipeline of the plurality of data pipelines connects a database reader and a transformer of the data processing tool, a transformer and a database writer of the data processing tool, or two transformers of the data processing tool. The one or more processors are further configured to refrain from reading data from one or more databases responsive to the congestion condition.

    System and method for batch and real-time feature computation

    公开(公告)号:US11971882B2

    公开(公告)日:2024-04-30

    申请号:US17639125

    申请日:2020-08-26

    Inventor: Ni Mu Taize Wang

    CPC classification number: G06F16/2386 G06F16/25 G06F16/27

    Abstract: The present disclosure discloses a system and method for batch and real-time feature computation, and the system includes: a management server, one or more batch feature computing units, one or more distributed computing units, one or more real-time feature computing units, an offline database and a real-time database. The management server receives a script containing feature computing logics, starts batch feature computation in a batch feature computing scenario, and deploys the script in a real-time feature computing scenario to generate a real-time computing plan, wherein the script containing the feature computing logics has unity for batch feature computing logics and real-time feature computing logics, and the real-time database obtains and stores data for the real-time feature computation from the offline database. According to the present disclosure, the batch feature computing logics and the real-time feature computing logics may be unified by the script.

Patent Agency Ranking