公开(公告)号：US10089342B2

公开(公告)日：2018-10-02

申请号：US14328511

申请日：2014-07-10

Applicant: Reza Sherkat ,  Guenter Radestock ,  Ivan Schreter ,  Colin Florendo ,  Mihnea Andrei ,  Anil Kumar Goel

Inventor： Reza Sherkat ,  Guenter Radestock ,  Ivan Schreter ,  Colin Florendo ,  Mihnea Andrei ,  Anil Kumar Goel

IPC: G06F17/30

Abstract: A compression manager may store, within an index vector, a plurality of value identifiers (IDs), each value ID representing a value within a database. A page generator may designate a number of the value IDs as defining a page within the index vector, so that the index vector includes a plurality of pages, each page including the number of value IDs. The page generator may store the index vector in a secondary memory of a main memory database. An iterator may access a requested value ID, and a page loader may load a corresponding page of the index vector that contains the requested value ID into the main memory database.

公开(公告)号：US09558216B2

公开(公告)日：2017-01-31

申请号：US14549806

申请日：2014-11-21

Applicant: Colin Florendo ,  Ivan Schreter

Inventor： Colin Florendo ,  Ivan Schreter

IPC: G06F17/30

CPC classification number: G06F17/303 ,  G06F17/30339 ,  G06F17/30958

Abstract: The present disclosure involves systems, software, and computer implemented methods for moving a table from a source node to a destination node. In one example, the method includes receiving metadata associated with an in-memory database table stored at a source node. A table container is created responsive to receiving the metadata. The destination node sequentially requests, from the source node, portions of the table, wherein the table is serialized at the source node to provide a serialized sequence of table portions. Sequentially requesting comprises sending a request for a next portion of the table after processing a received portion, which includes receiving a portion of the serialized table, deserializing the received portion, adding the deserialized portion to the created table container, and in response to an end of file indication associated with the received portion, ending the requests and finalizing the table.

Abstract translation: 本公开涉及用于将表从源节点移动到目的地节点的系统，软件和计算机实现的方法。 在一个示例中，该方法包括接收与存储在源节点处的存储器内数据库表相关联的元数据。 响应于接收元数据创建表容器。 目的地节点从源节点顺序地请求表的部分，其中表在源节点被序列化以提供表部分的序列化序列。 顺序请求包括在处理接收到的部分之后发送对表的下一部分的请求，该接收部分包括接收序列化表的一部分，对接收到的部分进行反序列化，将反序列化部分添加到创建的表容器中，并响应于结束 与所接收的部分相关联的文件指示，结束请求并完成表格。

公开(公告)号：US20160147834A1

公开(公告)日：2016-05-26

申请号：US14553226

申请日：2014-11-25

Applicant: Juchang Lee ,  Mihnea Andrei ,  Colin Florendo ,  Ivan Schreter ,  Anil Kumar Goel

Inventor： Juchang Lee ,  Mihnea Andrei ,  Colin Florendo ,  Ivan Schreter ,  Anil Kumar Goel

IPC: G06F17/30

CPC classification number: G06F17/30463 ,  G06F17/30339 ,  G06F17/30345 ,  G06F17/30353 ,  G06F17/30548

Abstract: Disclosed herein are system, method, and computer program product embodiments for determining row visibility states. An embodiment operates by initializing a result bitmap for rows based on visible row state values of row state bitmaps corresponding to the rows, wherein values of the result bitmap indicate whether the row are visible or not visible; determining one or more rows whose corresponding visible row state values indicate that the one or more rows are not visible; and determining whether to update the result bitmap to indicate that the one or more rows are visible based on one or more versioned row state values, wherein the one or more versioned row state values indicate whether the corresponding rows are not visible or possibly visible.

Abstract translation: 这里公开了用于确定行可见性状态的系统，方法和计算机程序产品实施例。 实施例通过基于与行对应的行状态位图的可见行状态值来初始化行的结果位图来进行操作，其中结果位图的值指示该行是可见还是不可见; 确定其对应的可见行状态值指示所述一行或多行不可见的一行或多行; 以及基于一个或多个版本化的行状态值来确定是否更新所述结果位图以指示所述一行或多行是可见的，其中所述一个或多个版本化行状态值指示相应行是否不可见或可见。

公开(公告)号：US20150142819A1

公开(公告)日：2015-05-21

申请号：US14524998

申请日：2014-10-27

Applicant: Colin Florendo ,  Ivan Schreter ,  Mihnea Andrei

Inventor： Colin Florendo ,  Ivan Schreter ,  Mihnea Andrei

IPC: G06F17/30

CPC classification number: G06F17/30312

Abstract: Techniques for handling large string values in a string dictionary within an in-memory database system are presented. The string dictionary can be a paged-column main dictionary. For example, a value block of a dictionary may be loaded into memory, where the dictionary stores values for dictionary compression. The value block may include a first portion of a large string value and one or more logical pointers to one or more large string pages containing a remainder of the large string value. The large string value may be materialized into a contiguous location in memory, and a pointer to the materialized large string value may be created.

Abstract translation: 介绍了在内存数据库系统中处理字符串字典中大字符串值的技术。 字典字典可以是分页列主字典。 例如，字典的值块可以被加载到存储器中，其中字典存储用于字典压缩的值。 值块可以包括大字符串值的第一部分和包含大字符串值的余数的一个或多个大字符串页的一个或多个逻辑指针。 大字符串值可以被实现到存储器中的连续位置，并且可以创建指向物化的大字符串值的指针。

公开(公告)号：US09009439B2

公开(公告)日：2015-04-14

申请号：US13797664

申请日：2013-03-12

Applicant: Ivan Schreter ,  Dirk Thomsen ,  Colin Florendo ,  Blaine French

Inventor： Ivan Schreter ,  Dirk Thomsen ,  Colin Florendo ,  Blaine French

IPC: G06F13/00 ,  G06F13/28 ,  G06F3/06 ,  G06F12/08

CPC classification number: G06F3/0674 ,  G06F3/0611 ,  G06F3/0635 ,  G06F12/0888 ,  G06F17/30312

Abstract: Data records of a data set can be stored in a plurality of main part fragments retained in on-disk storage. A size of the data set can be compared to an available size of main system memory. All of the plurality of main part fragments can be fully loaded into the main system memory when the available size of the main system memory is larger than the size of the data set. Alternatively, one or more of the of main part fragments can be paged into the main system memory on demand in response to a data access request when the available size of the main system memory is smaller than the size of the data set and the data access request can be satisfied by providing access to a subset of the main part fragments, or access can be provided directly to the on-disk main part fragments when the data access request involves random access for projection in the data set and the available size of the main system memory is smaller than the size of the data set.

Abstract translation: 数据集的数据记录可以存储在保存在盘上存储器中的多个主要部分片段中。 可以将数据集的大小与主系统存储器的可用大小进行比较。 当主系统存储器的可用尺寸大于数据集的大小时，所有多个主要部分片段可以完全加载到主系统存储器中。 或者，当主系统存储器的可用尺寸小于数据集的大小和数据访问的大小时，响应于数据访问请求，主要部分片段中的一个或多个可以根据需要被分页到主系统存储器中 可以通过提供对主要部分片段的子集的访问来满足请求，或者当数据访问请求涉及数据集中的投影的随机访问以及数据集的可用大小时，可以直接向磁盘上的主要部分片段提供访问 主系统内存小于数据集的大小。

公开(公告)号：US20150046413A1

公开(公告)日：2015-02-12

申请号：US13960335

申请日：2013-08-06

Applicant: Mihnea ANDREI ,  Colin Florendo ,  Anil Goel

Inventor： Mihnea ANDREI ,  Colin Florendo ,  Anil Goel

IPC: G06F17/30

CPC classification number: G06F17/30362 ,  G06F11/1448 ,  G06F17/30309 ,  G06F17/30312 ,  G06F17/30315 ,  G06F17/30339 ,  G06F17/30368 ,  G06F17/30371 ,  G06F2201/80 ,  G06F2201/825 ,  G06F2201/84 ,  G06F2201/87

Abstract: A delta store giving row-level versioning semantics to a non-row-level versioning underlying store is described. An example method includes establishing a column-based in-memory database including a main store and a delta store, where the main store does not allow concurrent transactions on a same table and the delta store has a plurality of row-visibility bitmaps implementing a row-level versioning mechanism that allows concurrent transactions on the same table. A transaction associated with the column-based in-memory database is received. For each table read by the transaction, a version of the table in the delta store that represents a transaction-consistent snapshot of the database visible to the transaction is determined. Each table is represented in the main store and the delta store; and each version of the table is represented by one or more bitmaps. Upon execution of a DML as part of the transaction, for each table written by the transaction, the data changes generated by the transaction is recorded in the one or more bitmaps that represent a private version of the table. Upon commit of the transaction, for each table written by the transaction, a new public version of the table is generated based on the private version of the table, and the public version represents a new transaction-consistent snapshot of the database visible to subsequent transactions.

Abstract translation: 描述了向非行级版本化底层商店提供行级版本化语义的增量存储。 示例性方法包括建立包括主存储和增量存储的基于列的存储器内数据库，其中主存储不允许同一表上的并发事务，并且增量存储具有实现行的多个行可见性位图 -level版本控制机制允许同一个表上的并发事务。 接收与基于列的内存数据库相关联的事务。 对于由事务读取的每个表，确定delta存储中表示事务可见的数据库的事务一致性快照的表的版本。 每个表在主商店和三角洲商店中表示; 并且表的每个版本由一个或多个位图表示。 在作为事务的一部分执行DML时，对于由事务写入的每个表，由事务生成的数据更改记录在表示该表的私有版本的一个或多个位图中。 在事务提交后，对于由事务编写的每个表，基于表的私有版本生成新的公用版本，而公共版本表示后续事务可见的数据库的新事务一致性快照 。

公开(公告)号：US20140281212A1

公开(公告)日：2014-09-18

申请号：US13797664

申请日：2013-03-12

Applicant: Ivan Schreter ,  Dirk Thomsen ,  Colin Florendo ,  Blaine French

Inventor： Ivan Schreter ,  Dirk Thomsen ,  Colin Florendo ,  Blaine French

IPC: G06F3/06

CPC classification number: G06F3/0674 ,  G06F3/0611 ,  G06F3/0635 ,  G06F12/0888 ,  G06F17/30312

Abstract: Data records of a data set can be stored in a plurality of main part fragments retained in on-disk storage. A size of the data set can be compared to an available size of main system memory. All of the plurality of main part fragments can be fully loaded into the main system memory when the available size of the main system memory is larger than the size of the data set. Alternatively, one or more of the of main part fragments can be paged into the main system memory on demand in response to a data access request when the available size of the main system memory is smaller than the size of the data set and the data access request can be satisfied by providing access to a subset of the main part fragments, or access can be provided directly to the on-disk main part fragments when the data access request involves random access for projection in the data set and the available size of the main system memory is smaller than the size of the data set.

Abstract translation: 数据集的数据记录可以存储在保存在盘上存储器中的多个主要部分片段中。 可以将数据集的大小与主系统存储器的可用大小进行比较。 当主系统存储器的可用尺寸大于数据集的大小时，所有多个主要部分片段可以完全加载到主系统存储器中。 或者，当主系统存储器的可用尺寸小于数据集的大小和数据访问的大小时，响应于数据访问请求，主要部分片段中的一个或多个可以根据需要被分页到主系统存储器中 可以通过提供对主要部分片段的子集的访问来满足请求，或者当数据访问请求涉及数据集中的投影的随机访问以及数据集的可用大小时，可以直接向磁盘上的主要部分片段提供访问 主系统内存小于数据集的大小。

公开(公告)号：US09977801B2

公开(公告)日：2018-05-22

申请号：US14333224

申请日：2014-07-16

Applicant: Colin Florendo ,  Carsten Thiel ,  Ivan Schreter ,  Mihnea Andrei ,  Anil Kumar Goel

Inventor： Colin Florendo ,  Carsten Thiel ,  Ivan Schreter ,  Mihnea Andrei ,  Anil Kumar Goel

IPC: G06F7/00 ,  G06F17/30

CPC classification number: G06F17/30312

Abstract: A request for an entry of a dictionary having multiple dictionary blocks may be received, where the dictionary stores string values associated with corresponding value identifiers (IDs) for dictionary compression. One of the dictionary blocks may be selectively loaded into memory, and the dictionary block that has been loaded into memory may be searched. A value ID directory may be constructed in memory, where the value ID directory includes last value IDs for the dictionary blocks, and each of the last value IDs is mapped to an index of one of the dictionary blocks that includes a string value for that last value ID. A separator directory may also be constructed in memory, where the separator directory includes separators for the dictionary blocks, and each of the separators is mapped to an index of one of the dictionary blocks that includes a string value for that separator.

公开(公告)号：US09734173B2

公开(公告)日：2017-08-15

申请号：US13797785

申请日：2013-03-12

Applicant: Ivan Schreter ,  Dirk Thomsen ,  Colin Florendo ,  Blaine French

Inventor： Ivan Schreter ,  Dirk Thomsen ,  Colin Florendo ,  Blaine French

IPC: G06F7/00 ,  G06F17/00 ,  G06F17/30

CPC classification number: G06F17/30312 ,  G06F17/30345

Abstract: A plurality of data records that comprise a data set can be stored in a plurality of main part fragments such that each main part fragment includes a subset of the set of data records. Each fragment of the plurality of main part fragments can be assigned a relative data temperature. A newly arrived data record for storage in the data set can be placed in a delta part, and a merge can be performed to add the newly arrived data record to a corresponding main part fragment. The performing of the merge can occur more quickly if the corresponding main part fragment has a higher relative data temperature than if the corresponding main part fragment has a lower relative data temperature.

公开(公告)号：US20160147776A1

公开(公告)日：2016-05-26

申请号：US14552902

申请日：2014-11-25

Applicant: Colin Florendo ,  Ivan Schreter ,  Panfeng Zhou ,  David Wein ,  Steffen Geissinger ,  Michael Muehle

Inventor： Colin Florendo ,  Ivan Schreter ,  Panfeng Zhou ,  David Wein ,  Steffen Geissinger ,  Michael Muehle

IPC: G06F17/30

Abstract: Disclosed herein are system, method, and computer program product embodiments for altering the data type of a column in a database. An embodiment operates by converting an original dictionary associated with a column into a new dictionary. The new dictionary stores the values of the original dictionary using a different data type. An index vector containing the keys of the original dictionary is then updated to contain the associated keys of the new dictionary. Because the size of the original dictionary is often substantially smaller than the number of rows in the associated column, this dictionary conversion decreases the computation cost to the database system of altering the data type of the column and reduces or even minimizes database downtime for users.

Abstract translation: 这里公开了用于改变数据库中的列的数据类型的系统，方法和计算机程序产品实施例。 实施例通过将与列相关联的原始字典转换为新字典来操作。 新字典使用不同的数据类型存储原始字典的值。 然后，将包含原始字典的键的索引向量更新为包含新字典的相关键。 由于原始字典的大小通常远小于相关列中的行数，因此该字典转换会降低数据库系统的更改列数据类型的计算成本，并减少或甚至最小化用户数据库停机时间。