公开(公告)号：WO2011160054A1

公开(公告)日：2011-12-22

申请号：PCT/US2011/040936

申请日：2011-06-17

Applicant: MAPR TECHNOLOGIES INC.

Inventor： SRIVAS, Mandayam, C. ,  RAVINDRA, Pindikura ,  SARADHI, Uppaluri, Vijaya ,  PANDE, Arvind, Arun ,  SANAPALA, Chndra Garu, Kiran Babu ,  RENU, Lohit, Vijaya ,  VELLANKI, Vivekanand ,  KAVACHERI, Sathya ,  HADKE, Amit, Ashoke

IPC: G06F12/00

CPC classification number: G06F17/30215 ,  G06F8/658 ,  G06F17/30067 ,  G06F17/30174 ,  G06F17/30194 ,  G06F17/30227 ,  G06F17/30312 ,  G06F17/30327 ,  G06F17/30345 ,  G06F17/30365 ,  G06F17/30371 ,  G06F17/30575 ,  G06F17/30581 ,  H04L65/102

Abstract: A map-reduce compatible distributed file system that consists of successive component layers that each provide the basis on which the next layer is built provides transactional read-write-update semantics with file chunk replication and huge file-create rates. A primitive storage layer (storage pools) knits together raw block stores and provides a storage mechanism for containers and transaction logs. Storage pools are manipulated by individual file servers. Containers provide the fundamental basis for data replication, relocation, and transactional updates. A container location database allows containers to be found among all file servers, as well as defining precedence among replicas of containers to organize transactional updates of container contents. Volumes facilitate control of data placement, creation of snapshots and mirrors, and retention of a variety of control and policy information. Key-value stores relate keys to data for such purposes as directories, container location maps, and offset maps in compressed files.

Abstract translation: 由连续的组件层组成的map-reduce兼容分布式文件系统，每个组件层提供下一层构建的基础，提供具有文件块复制和巨大的文件创建速率的事务读写更新语义。 原始存储层（存储池）将原始块存储器编织在一起，并为容器和事务日志提供存储机制。 存储池由单独的文件服务器操纵。 容器为数据复制，重定位和事务更新提供了基础。 容器位置数据库允许在所有文件服务器之间找到容器，以及在容器的副本之间定义优先级以组织容器内容的事务性更新。 卷有助于控制数据放置，创建快照和镜像，以及保留各种控制和策略信息。 密钥值存储将密钥与数据相关联，用于压缩文件中的目录，容器位置映射和偏移映射。