Heterogeneous schema discovery for unstructured data

    公开(公告)号:US11947561B2

    公开(公告)日:2024-04-02

    申请号:US17807884

    申请日:2022-06-21

    Abstract: An embodiment for analyzing and tracking data flow to determine proper schemas for unstructured data. The embodiment may automatically use a sidecar to collect schema discovery rules during conversion of raw data to unstructured data. The embodiment may automatically generate multiple schemas for different tenants using the collected schema discovery rules. The embodiment may automatically use ETL to export unstructured data to SQL databases with the generated multiple schemas for the different tenants. The embodiment may automatically monitor usage data of the SQL databases and collect the usage data. The embodiment may automatically optimize schema discovery using the collected usage data. The embodiment may automatically discover schemas with hot usage and apply the discovered schemas with hot usage to other tenants for consumption and further monitoring.

    Dynamically changing query mini-plan with trustworthy AI

    公开(公告)号:US11914594B1

    公开(公告)日:2024-02-27

    申请号:US18147435

    申请日:2022-12-28

    CPC classification number: G06F16/24542 G06F16/24549

    Abstract: A disclosed database system and enhanced methods implement enhanced mini-plans and dynamically changing a query mini-plan with trustworthy Artificial Intelligence (AI) to improve query execution performance in a database system. An AI cost model evaluates candidate mini-plans for executing a query. AI truth monitors evaluate the execution of the mini-plans, such as predicted input factors and adjusted mini-plans of one or more AI running data models. The AI truth monitors provide feedback to adjust the AI cost model based on evaluating the execution of the mini-plans. The AI truth monitors validate adjusted mini-plans, provide feedback to the AI cost model with improved overall prediction accuracy, and enhanced mini-plans to gain query performance.

    Abnormal data detection
    14.
    发明授权

    公开(公告)号:US11651031B2

    公开(公告)日:2023-05-16

    申请号:US16988776

    申请日:2020-08-10

    CPC classification number: G06F16/9024

    Abstract: A method, system, and computer program product for abnormal data detection. According to the method, a plurality of data points collected at different time points are classified into a plurality of groups. A plurality of groups of potential abnormal data points are determined from the plurality of groups. Correlations between a first group of the plurality of groups of potential abnormal data points with other groups of potential abnormal data points are determined. In response to the first group of the plurality of groups of potential abnormal data points being uncorrelated to a majority of the other groups of potential abnormal data points based on the correlations, data points in the first group are identified as abnormal data points.

    ESTIMATING CLOUD RESOURCES FOR BATCH PROCESSING

    公开(公告)号:US20220179769A1

    公开(公告)日:2022-06-09

    申请号:US17116867

    申请日:2020-12-09

    Abstract: Embodiments are disclosed for a method. The method includes determining demand resource for a batch jobs using a resource machine learning model trained to determine a cloud resource that the batch jobs use more than other resources during execution. The method further includes generating resource estimates for the demand resources. Additionally, the method includes determining a batch rating for a batch run using a batch rating machine learning model that is trained to generate a batch rating number based on features representing a priority of the batch run in reference to parallel execution batch runs. The method also includes generating a purchase recommendation for execution of the batch run on a cloud platform based on the resource estimates and the batch rating.

    Lightweight DBMS based on functional microservices

    公开(公告)号:US11321322B2

    公开(公告)日:2022-05-03

    申请号:US16834369

    申请日:2020-03-30

    Abstract: A lightweight database-management system (DBMS) is based on a dynamic microservices architecture that implements each granular DBMS feature or function as a distinct, independently executable microservice. The DBMS's Parser front-end responds to each incoming query by selecting the first bind-time database feature needed to process the query. The Parser forwards its selection through a Channel-Binding subsystem to an Event Services Activation subsystem that activates a corresponding microservice to perform the selected feature. The first feature then selects the next required bind-time feature for activation, and this process continues sequentially until all required bind-time microservices have been identified, activated, and run. Runtime query-processing features are then sequentially selected in a similar manner. However, each selected runtime microservice is preloaded but not run. Only when all runtime functions have been identified does the Parser send an asynchronous message to the Channel-Binding subsystem directing the DBMS engine to run the preloaded runtime microservices.

    LIGHTWEIGHT DBMS BASED ON FUNCTIONAL MICROSERVICES

    公开(公告)号:US20210303577A1

    公开(公告)日:2021-09-30

    申请号:US16834369

    申请日:2020-03-30

    Abstract: A lightweight database-management system (DBMS) is based on a dynamic microservices architecture that implements each granular DBMS feature or function as a distinct, independently executable microservice. The DBMS's Parser front-end responds to each incoming query by selecting the first bind-time database feature needed to process the query. The Parser forwards its selection through a Channel-Binding subsystem to an Event Services Activation subsystem that activates a corresponding microservice to perform the selected feature. The first feature then selects the next required bind-time feature for activation, and this process continues sequentially until all required bind-time microservices have been identified, activated, and run. Runtime query-processing features are then sequentially selected in a similar manner. However, each selected runtime microservice is preloaded but not run. Only when all runtime functions have been identified does the Parser send an asynchronous message to the Channel-Binding subsystem directing the DBMS engine to run the preloaded runtime microservices.

    Database Tuning Using a Federated Machine Learning System of a Centerless Network

    公开(公告)号:US20210064591A1

    公开(公告)日:2021-03-04

    申请号:US16550465

    申请日:2019-08-26

    Abstract: Database configuration tuning is provided. A set of database nodes having similar data factors is selected in a centerless network of database nodes. Configuration models corresponding to the set of database nodes are trained using data parallelism. Trained configuration models corresponding to the set of database nodes are combined to form a federated configuration model. It is determined whether performance indicators corresponding to the set of database nodes are greater than a performance threshold level. In response to determining that the performance indicators corresponding to the set of database nodes are greater than the performance threshold level, a database configuration corresponding to the federated configuration model is recommended to a new database node. The new database node is joined to the centerless network.

    Dynamic assistant for applications based on pattern analysis

    公开(公告)号:US10176000B2

    公开(公告)日:2019-01-08

    申请号:US15055706

    申请日:2016-02-29

    Abstract: A method for providing application assistants on applications is provided. The method may include performing pattern analyses on the applications, wherein application features are collected. The method may include determining application pattern types based on the pattern analyses. The method may include determining whether user customizations associated with the determined application pattern types are received. The method may include in response to the determination that user customizations are not received, associating the determined application pattern types with the applications, and generating application assistants based on the associated determined application pattern types. The method may include in response to the determination that user customizations are received, associating the user customizations with the applications, and generating application assistants based on the associated user customizations. The method may include presenting the generated application assistants in application assistant windows on the applications. The method may include executing actions on the generated application assistants.

    VIRTUALIZING TCP/IP SERVICES WITH SHARED MEMORY TRANSPORT

    公开(公告)号:US20170357614A1

    公开(公告)日:2017-12-14

    申请号:US15664903

    申请日:2017-07-31

    CPC classification number: G06F15/17331 H04L43/00 H04L67/38 H04L67/42 H04L69/16

    Abstract: A method for testing a client service locally using a shared memory transport is presented. The method may include recording a plurality of interactions between the client service located in a local host and a real server. The method may include generating a virtual server based on the recorded plurality of interactions. The method may include deploying the generated virtual server in the local host. The method may include executing the client service. The method may include receiving a TCP/IP request from the client service. The method may include converting the received TCP/IP request to a shared memory request. The method may include sending the shared memory request to the virtual server. The method may include receiving a shared memory reply from the virtual server. The method may include sending the shared memory reply to the client service.

Patent Agency Ranking