Big object bulk data ingest
    1.
    发明授权

    公开(公告)号:US10908947B2

    公开(公告)日:2021-02-02

    申请号:US15374787

    申请日:2016-12-09

    Abstract: Techniques and architectures for data ingestion in an environment having a distributed data storage system. A request to import data into the environment. The data to be imported from an external source through an application programming interface (API). The request is analyzed to determine if the request corresponds to a request to import a large data load. The data is staged if the request is for the large data load. Data management jobs are created to cause the data to be stored in one or more nodes of the distributed data storage system. The data management jobs are transmitted to corresponding nodes in the distributed data storage system. The jobs are executed asynchronously to cause the data to be stored in the nodes.

    Composite keys for multi-tenant non-relational platform objects

    公开(公告)号:US10579692B2

    公开(公告)日:2020-03-03

    申请号:US15717788

    申请日:2017-09-27

    Abstract: Disclosed are examples of systems, apparatus, methods and computer program products for providing a web application builder framework in a database system. A database system maintains a multi-tenant non-relational database associated with a number of enterprises, a number of records, and a number of data objects for each of the enterprises. A dynamic virtual table is maintained as well, associated with the number of records and number of data objects. A user request is received to define a composite key for a data object. A metadata model is generated representing the data object, and a data definition script is generated. The dynamic virtual table is updated to include one or more virtual columns corresponding to the data definition script, and one or more columns of a shared table in the non-relational database are updated to match the virtual columns.

    RULES-BASED SYNCHRONOUS QUERY PROCESSING FOR LARGE DATASETS IN AN ON-DEMAND ENVIRONMENT

    公开(公告)号:US20190042573A1

    公开(公告)日:2019-02-07

    申请号:US15665529

    申请日:2017-08-01

    Abstract: In accordance with embodiments, there are provided mechanisms and methods for facilitating rules-based synchronous query processing for large datasets in an on-demand services environment according to one embodiment. In one embodiment and by way of example, a method comprises detecting, by a rules-management server computing device, at least one of efficient classes and inefficient classes associated with a query, and designating a set of rules to the query, where one or more of the set of rules are designated to the query to prevent the inefficient classes from being processed or allow the query to fail fast. The method may further include executing the query without processing the inefficient classes such that results are generated within a predictable amount of time, where executing includes accessing contents of one or more portions of a database as identified by the set of rules, and transmitting the results in response to the query.

    EXECUTION OF QUERIES IN RELATIONAL DATABASES

    公开(公告)号:US20200226153A1

    公开(公告)日:2020-07-16

    申请号:US16826673

    申请日:2020-03-23

    Abstract: A learning system is provided to improve the speed of queries in a relational database management system. The learning system may include a query pipeline which utilizes a transform generator and a transform engine to transform uncommitted data corresponding to slow queries, and a query multiplexer to query primary keys of uncommitted data and committed data if the query has been improved by an existing transform.

    RUN-TIME QUERYING OF MULTI-TENANT NON-RELATIONAL PLATFORM OBJECTS

    公开(公告)号:US20190095532A1

    公开(公告)日:2019-03-28

    申请号:US15717772

    申请日:2017-09-27

    Abstract: Disclosed are examples of systems, apparatus, methods and computer program products for providing run-time querying of muli-tenant non-relational database objects. A database system maintains a multi-tenant non-relational database associated with a number of enterprises, a number of records, and a number of data objects for each of the enterprises, each data object having at least one composite key field. A request is received during runtime to query data related to a data object, and the system determines that the data object is defined to be used in associated with a non-relational database. The system then retrieves a metadata model of the data object, determines that the request includes at least one composite key field for the data object, and processes the requery to query data in synchronous fashion. Finally, a query response is provided to the user.

    MULTI-TENANT NON-RELATIONAL PLATFORM OBJECTS

    公开(公告)号:US20180096012A1

    公开(公告)日:2018-04-05

    申请号:US15283119

    申请日:2016-09-30

    CPC classification number: G06F16/2282

    Abstract: Disclosed are examples of systems, apparatus, methods and computer program products for updating and managing multi-tenant non-relational database schemas. A database system maintains a multi-tenant non-relational database associated with multiple enterprises. A number of records are stored for each of the enterprises. The system also maintains a dynamic virtual table storing a number of records. A request is received from a user of the database system to define a data object within the database system. The request is processed, and an object script is generated based on the request, the object script defining one or more database columns in the database system that are associated with the data object. The dynamic virtual table is updated such that one or more virtual columns match the database column definitions in the object script. Existing columns of a shared table in the multi-tenant non-relational database are then updated to match the virtual columns in the dynamic virtual table.

    Offloading data to a cold storage database

    公开(公告)号:US11301485B2

    公开(公告)日:2022-04-12

    申请号:US16564516

    申请日:2019-09-09

    Abstract: Methods, systems, and devices supporting data archiving are described. A device (e.g., an application server) may identify a set of archiving jobs for a first database (e.g., a relational database), where each archiving job indicates a set of data records for archiving. The device may receive a data record of the set of data records from the first database, where the data record is filtered by an abstraction layer (e.g., removing some information from the data record such that the filtered data record corresponds to a user's view of the data record). For example, the filtered data record may include a subset of the total information for the stored data record. The device may transform this received, filtered data record from a first format to a second format supported by a second database. The device may then send the transformed data record to the second database for storage.

Patent Agency Ranking