System and method for data transfer from JDBC to a data warehouse layer in a massively parallel or distributed database environment

    公开(公告)号:US10089377B2

    公开(公告)日:2018-10-02

    申请号:US14864782

    申请日:2015-09-24

    Abstract: A system and method is described for database split generation in a massively parallel or distributed database environment including a plurality of databases and a data warehouse layer providing data summarization and querying functionality. A database table accessor of the system obtains, from an associated client application, a query for data in a table of the data warehouse layer, wherein the query includes a user preference. The system obtains table data representative of properties of the table, and determines a splits generator in accordance with one or more of the user preference or the properties of the table. The system generates, by the selected splits generator, table splits dividing the user query into a plurality of query splits, and outputs the plurality of query splits to an associated plurality of mappers for execution by the associated plurality of mappers of each of the plurality of query splits against the table.

    System and method for generating partition-based splits in a massively parallel or distributed database environment

    公开(公告)号:US10089357B2

    公开(公告)日:2018-10-02

    申请号:US14864776

    申请日:2015-09-24

    Abstract: A system and method is described for database split generation in a massively parallel or distributed database environment including a plurality of databases and a data warehouse layer providing data summarization and querying functionality. A database table accessor of the system obtains, from an associated client application, a query for data in a table of the data warehouse layer, wherein the query includes a user preference. The system obtains table data representative of properties of the table, and determines a splits generator in accordance with one or more of the user preference or the properties of the table. The system generates, by the selected splits generator, table splits dividing the user query into a plurality of query splits, and outputs the plurality of query splits to an associated plurality of mappers for execution by the associated plurality of mappers of each of the plurality of query splits against the table.

    System and method for marshaling massive database data from native layer to java using linear array

    公开(公告)号:US09600546B2

    公开(公告)日:2017-03-21

    申请号:US14251410

    申请日:2014-04-11

    CPC classification number: G06F17/3056

    Abstract: A system and method for marshaling database data from a native interface layer, to a Java layer, using a linear array. In accordance with an embodiment, a request is received from a software application to query or access data stored at the database. At a database driver native interface layer, the system obtains cell data from the database, determines cell coordinates and a cell metadata, and linearizes the cell data if required. The linearized data is then flushed to a linear byte array in the database driver presentation layer, and the cell coordinates and cell metadata are provided for use by a compact data handler and the application in accessing the data.

    SYSTEM AND METHOD FOR PROVIDING ACCESS TO A SHARDED DATABASE USING A CACHE AND A SHARD TECHNOLOGY
    24.
    发明申请
    SYSTEM AND METHOD FOR PROVIDING ACCESS TO A SHARDED DATABASE USING A CACHE AND A SHARD TECHNOLOGY 审中-公开
    使用高速缓存和削减技术提供访问受保护数据库的系统和方法

    公开(公告)号:US20160306832A1

    公开(公告)日:2016-10-20

    申请号:US15133979

    申请日:2016-04-20

    Abstract: In accordance with an embodiment, the system enables access to a sharded database using a cache and a shard topology. A shard-aware client application connecting to a sharded database can use a connection pool (e.g., a Universal Connection Pool, UCP), to store or access connections to different shards or chunks of the sharded database within a shared pool. As new connections are created, a shard topology layer can be built at the database driver layer, which learns and caches shard key ranges to locations of shards. The shard topology layer enables subsequent connection requests from a client application to use a fast key path access to the appropriate shard or chunk.

    Abstract translation: 根据实施例,该系统使得能够使用高速缓存和分片拓扑来访问分片数据库。 连接到分片数据库的分片识别客户端应用程序可以使用连接池(例如,通用连接池,UCP)来存储或访问到共享池内的分片数据库的不同碎片或块的连接。 当创建新连接时,可以在数据库驱动程序层构建分片拓扑图层,数据库驱动程序层可以将分片键范围学习并缓存到分片的位置。 分片拓扑层使来自客户端应用程序的后续连接请求能够使用快速键路径访问适当的分片或块。

    EFFICIENT STORAGE AND RETRIEVAL OF FRAGMENTED DATA USING PSEUDO LINEAR DYNAMIC BYTE ARRAY
    25.
    发明申请
    EFFICIENT STORAGE AND RETRIEVAL OF FRAGMENTED DATA USING PSEUDO LINEAR DYNAMIC BYTE ARRAY 有权
    使用PSEUDO线性动态字节阵列的有效存储和检索

    公开(公告)号:US20140380004A1

    公开(公告)日:2014-12-25

    申请号:US14259499

    申请日:2014-04-23

    CPC classification number: G06F17/30492

    Abstract: A system and method for efficient storage and retrieval of fragmented data using a pseudo linear dynamic byte array is provided. In accordance with an embodiment, the system comprises a database driver which provides access by a software application to a database. The database driver uses a dynamic byte array to enable access by the application to data in the database, including determining a size of a required data to be stored in memory, and successively allocating and copying the required data into the dynamic byte array as a succession of blocks. The data stored within the succession of blocks can then be accessed and provided to the application.

    Abstract translation: 提供了一种使用伪线性动态字节阵列有效地存储和检索分段数据的系统和方法。 根据实施例,该系统包括数据库驱动器,其提供软件应用程序对数据库的访问。 数据库驱动程序使用动态字节数组来使应用程序能够访问数据库中的数据,包括确定要存储在存储器中的所需数据的大小,并将所需数据连续分配并复制到动态字节数组中作为继承 的块。 存储在连续块内的数据可以被访问并提供给应用程序。

Patent Agency Ranking