Address generation in distributed systems using tree method

    公开(公告)号:US09444732B2

    公开(公告)日:2016-09-13

    申请号:US13953557

    申请日:2013-07-29

    申请人: Ivan Schreter

    发明人: Ivan Schreter

    摘要: Methods and apparatus, including computer program products, for managing a cluster of servers organized into nodes. A method of one aspect includes establishing a cluster; establishing a set of ultimate identifiers for nodes resulting from splitting in the cluster; and storing every new data object on a node that has a node identifier that identifies a subset of the set of ultimate identifiers, and providing for the object a universal identifier that combines (i) an object identifier that is unique on the node and (ii) a server identifier that is one of the ultimate identifiers in the subset. A method of another aspect includes generating for a new data object a universal identifier that has a node identifier part that uniquely identifies a node, a reserve part generated at least in part as a pseudo-random value, and an object identifier part that uniquely identifies the object in the node.

    FAST ROW TO PAGE LOOKUP OF DATA TABLE USING CAPACITY INDEX
    52.
    发明申请
    FAST ROW TO PAGE LOOKUP OF DATA TABLE USING CAPACITY INDEX 有权
    快速浏览使用能力指数的数据表查询

    公开(公告)号:US20160147904A1

    公开(公告)日:2016-05-26

    申请号:US14553878

    申请日:2014-11-25

    IPC分类号: G06F17/30

    摘要: The subject matter disclosed herein provides methods for determining the page on which a desired row position value is located. A table having a plurality of rows can be accessed. The rows can be distributed across one or more pages in an in-memory database. Each row can be associated with a unique row position value. Each page can be associated with a capacity that is representative of an amount of data stored on the page. A capacity index having a plurality of entries can be created to record changes in capacity between pages. Neighboring entries in the capacity index can have a different capacity. Each entry in the capacity index can correspond to a page. A page directory can be created based on the capacity index. The page directory can indicate all possible row position values associated with each page. Related apparatus, systems, techniques, and articles are also described.

    摘要翻译: 本文公开的主题提供了用于确定期望行位置值所位于的页面的方法。 可以访问具有多行的表。 这些行可以分布在内存数据库中的一个或多个页面上。 每行可以与唯一的行位置值相关联。 每个页面可以与表示页面上存储的数据量的容量相关联。 可以创建具有多个条目的容量索引以记录页面之间的容量变化。 容量指标中的相邻条目可以具有不同的容量。 容量索引中的每个条目可以对应一个页面。 可以基于容量索引创建页面目录。 页面目录可以指示与每个页面相关联的所有可能的行位置值。 还描述了相关装置,系统,技术和制品。

    Migration of Unified Table Metadata Graph Nodes
    53.
    发明申请
    Migration of Unified Table Metadata Graph Nodes 审中-公开
    统一表元数据图节点的迁移

    公开(公告)号:US20160147819A1

    公开(公告)日:2016-05-26

    申请号:US14553571

    申请日:2014-11-25

    IPC分类号: G06F17/30

    CPC分类号: G06F16/214

    摘要: Metadata is stored within a database for each of a plurality of objects in different frames associated with a structure descriptor (e.g., a container directory entry, etc.). The frames are part of a metadata page and each comprising an object and a header specifying a version identifier for the object and a size of the object. The structure descriptor initially is built for a first build identifier. Thereafter, upon the structure descriptor changing from the first build identifier to a second build identifier, at least one of the objects that require migration is identified. The identification is based on the version identifier for the object being different from the second build identifier. In response, the identified objects are migrated from their corresponding frame to a new frame. The new frame includes the objects and new headers that include a version identifier equal to the second build identifier.

    摘要翻译: 元数据存储在与结构描述符(例如,容器目录条目等)相关联的不同帧中的多个对象中的每一个的数据库内。 这些帧是元数据页面的一部分,并且每个框架包括对象和指定对象的版本标识符和对象的大小的标题。 结构描述符最初是为第一个构建标识符构建的。 此后,当结构描述符从第一构建标识符改变为第二构建标识符时,识别需要迁移的至少一个对象。 该标识基于与第二构建标识符不同的对象的版本标识符。 作为响应,所识别的对象从其对应的帧迁移到新的帧。 新帧包括包含与第二构建标识符相等的版本标识符的对象和新头。

    Database Lockless Index for Accessing Multi-Version Concurrency Control Data
    54.
    发明申请
    Database Lockless Index for Accessing Multi-Version Concurrency Control Data 审中-公开
    用于访问多版本并发控制数据的数据库无锁索引

    公开(公告)号:US20160147811A1

    公开(公告)日:2016-05-26

    申请号:US14553723

    申请日:2014-11-25

    IPC分类号: G06F17/30

    CPC分类号: G06F16/2308 G06F16/2228

    摘要: An operation on a row of a table of a database is initiated. Thereafter, a multi-version concurrency control (MVCC) object is accessed to identify blocks associated with the row position of the row using bitwise operations. Subsequently, a row state block computed based on the row position of the row is accessed to determine a row state for the row. At least one other block is accessed, based in part on the row state, to obtain at least one timestamp from the computed offset based on the row. Next, the at least one timestamp is stored or retrieved. Related apparatus, systems, techniques and articles are also described.

    摘要翻译: 启动对数据库表的一行的操作。 此后,访问多版本并发控制(MVCC)对象以使用逐位操作来识别与行的行位置相关联的块。 随后,访问基于行的行位置计算的行状态块以确定该行的行状态。 部分地基于行状态访问至少一个其他块,以从基于该行的所计算的偏移获得至少一个时间戳。 接下来,存储或检索至少一个时间戳。 还描述了相关设备,系统,技术和物品。

    Efficient Block-Level Space Allocation for Multi-Version Concurrency Control Data
    55.
    发明申请
    Efficient Block-Level Space Allocation for Multi-Version Concurrency Control Data 有权
    用于多版本并发控制数据的高效块级空间分配

    公开(公告)号:US20160147448A1

    公开(公告)日:2016-05-26

    申请号:US14553680

    申请日:2014-11-25

    IPC分类号: G06F3/06

    摘要: Lockless allocation of a block from a page is initiated by computing a needed block size from an original block header value. Thereafter, a currently used block size and a capacity of the page are determined. A new block size is then computed based on the currently used block size and the needed block size and a remaining capacity of the page. A new block header value is subsequently generated that includes the determined new block size and the determined remaining capacity of the page The original block header value is then replaced with the new block header value. Related apparatus, systems, techniques and articles are also described.

    摘要翻译: 通过从原始块头值计算所需的块大小来启动来自页面的块的无锁定分配。 此后,确定当前使用的块大小和页面的容量。 然后基于当前使用的块大小和所需的块大小以及页面的剩余容量来计算新的块大小。 随后生成包括所确定的新的块大小和所确定的页面的剩余容量的新的块标题值。然后用新的块标题值替换原始块标题值。 还描述了相关设备,系统,技术和物品。

    Consolidation for updated/deleted records in old fragments
    56.
    发明授权
    Consolidation for updated/deleted records in old fragments 有权
    整合旧片段中更新/删除的记录

    公开(公告)号:US09348833B2

    公开(公告)日:2016-05-24

    申请号:US13797710

    申请日:2013-03-12

    IPC分类号: G06F12/00 G06F17/30

    摘要: A plurality of data records of a data set can be stored in a plurality of main part fragments, at least one of which is an old fragment stored on-disk. A number of one or more data records in the old fragment that have been marked for deletion can be determined to be greater than a threshold number, and the old fragment can be loaded into main system memory. A merge of the old fragment can be performed to remove the one or more data records marked for deletion.

    摘要翻译: 数据组的多个数据记录可以存储在多个主要部分片段中,其中至少一个是存储在磁盘上的旧片段。 已经标记为删除的旧片段中的一个或多个数据记录可以被确定为大于阈值数,并且旧片段可以被加载到主系统存储器中。 可以执行旧片段的合并,以删除标记为删除的一个或多个数据记录。

    LOCK-FREE PARALLEL DICTIONARY ENCODING
    57.
    发明申请
    LOCK-FREE PARALLEL DICTIONARY ENCODING 审中-公开
    无锁并行词典编码

    公开(公告)号:US20150324480A1

    公开(公告)日:2015-11-12

    申请号:US14272909

    申请日:2014-05-08

    申请人: Ivan Schreter

    发明人: Ivan Schreter

    IPC分类号: G06F17/30

    摘要: A system includes reception of a value, determination of whether the value is associated with a respective value identifier in a dictionary index associating each of a plurality of values with a respective value identifier, and in response to a determination that the value is not associated with a respective value identifier in the dictionary index: reservation of a slot of a reservation array comprising a plurality of slots, writing of the value into the reserved slot, insertion of a reserved value identifier of the reserved slot and a version counter of the reserved slot into a position of the dictionary index corresponding to the value, insertion of the value into a position of a dictionary vector storing a respective value in each of a plurality of vector positions, insertion of a first value identifier corresponding to the position of the dictionary vector into the position of the dictionary index corresponding to the value, and returning of the first value identifier.

    摘要翻译: 一种系统包括接收值,确定该值是否与将多个值中的每一个值与相应的值标识符相关联的词典索引中的相应值标识符相关联,以及响应于确定该值不与 字典索引中的相应值标识符:包括多个时隙的预留阵列的时隙的预留,将值写入预留时隙中,插入预留时隙的保留值标识符和预留时隙的版本计数器 进入与该值对应的字典索引的位置,将该值插入到在多个向量位置的每一个中存储相应值的字典向量的位置,插入对应于字典向量的位置的第一值标识符 进入与该值对应的字典索引的位置,并返回第一个值标识符。

    VARIABLE PAGE SIZING FOR IMPROVED PHYSICAL CLUSTERING
    58.
    发明申请
    VARIABLE PAGE SIZING FOR IMPROVED PHYSICAL CLUSTERING 有权
    改进的物理聚类的变化页面大小

    公开(公告)号:US20140297777A1

    公开(公告)日:2014-10-02

    申请号:US14302226

    申请日:2014-06-11

    IPC分类号: G06F3/06

    摘要: A data size characteristic of contents of a related unit of data to be written to a storage by an input/output module of a data storage application can be determined, and a storage page size consistent with the data size can be selected from a plurality of storage page sizes. The related unit of data can be assigned to a storage page having the selected storage page size, and the storage page can be passed to the input/output module so that the input/output module physically clusters the contents of the related unit of data when the input/output module writes the contents of the related unit of data to the storage. Related methods, systems, and articles of manufacture are also disclosed.

    摘要翻译: 可以确定由数据存储应用的输入/输出模块写入存储器的相关数据单元的内容的数据大小特性,并且可以从多个 存储页面大小。 可以将相关的数据单元分配给具有所选择的存储页面大小的存储页面,并且可以将存储页面传递到输入/输出模块,使得输入/输出模块物理地聚集相关数据单元的内容, 输入/输出模块将相关数据单元的内容写入存储器。 还公开了相关方法,系统和制品。

    Control block linkage for database converter handling
    59.
    发明授权
    Control block linkage for database converter handling 有权
    用于数据库转换器处理的控制块链接

    公开(公告)号:US08843708B2

    公开(公告)日:2014-09-23

    申请号:US13169855

    申请日:2011-06-27

    IPC分类号: G06F12/08 G06F17/30

    CPC分类号: G06F17/30327

    摘要: A system to load a plurality of converter pages of a datastore into a database cache, the plurality of converter pages comprising a plurality of converter inner pages, and a plurality of converter leaf pages, to allocate a control block in the database cache for each of the plurality of converter inner pages, the control block of a converter inner page comprising a pointer to a control block of a parent converter inner page and a pointer to a control block of each child converter page of the converter inner page, and to allocate a control block in the database cache for each of the plurality of converter leaf pages, the control block of a converter leaf page comprising a pointer to a control block of a parent converter inner page.

    摘要翻译: 一种将数据存储区的多个转换器页面加载到数据库高速缓存中的系统,所述多个转换器页面包括多个转换器内部页面和多个转换器叶子页面,以在数据库高速缓存中为每个转换器页面分配控制块 多个转换器内页,转换器内页的控制块包括指向父转换器内页的控制块的指针和指向转换器内页的每个子转换器页的控制块的指针,并且分配 多个转换器叶页中的每一个的数据库高速缓存中的控制块,转换器叶页面的控制块包括指向父转换器内页的控制块的指针。

    CONSOLIDATION FOR UPDATED/DELETED RECORDS IN OLD FRAGMENTS
    60.
    发明申请
    CONSOLIDATION FOR UPDATED/DELETED RECORDS IN OLD FRAGMENTS 有权
    旧版本更新/删除记录的综合

    公开(公告)号:US20140279962A1

    公开(公告)日:2014-09-18

    申请号:US13797710

    申请日:2013-03-12

    IPC分类号: G06F17/30

    摘要: A plurality of data records of a data set can be stored in a plurality of main part fragments, at least one of which is an old fragment stored on-disk. A number of one or more data records in the old fragment that have been marked for deletion can be determined to be greater than a threshold number, and the old fragment can be loaded into main system memory. A merge of the old fragment can be performed to remove the one or more data records marked for deletion.

    摘要翻译: 数据组的多个数据记录可以存储在多个主要部分片段中,其中至少一个是存储在磁盘上的旧片段。 已经标记为删除的旧片段中的一个或多个数据记录可以被确定为大于阈值数,并且旧的片段可以被加载到主系统存储器中。 可以执行旧片段的合并,以删除标记为删除的一个或多个数据记录。