公开(公告)号：US20160092125A1

公开(公告)日：2016-03-31

申请号：US14497200

申请日：2014-09-25

Applicant: Dropbox, Inc.

Inventor： James Cowling ,  James Turner

IPC: G06F3/06 ,  G06F12/02

CPC classification number: G06F3/0619 ,  G06F3/065 ,  G06F3/0655 ,  G06F3/0688 ,  G06F12/0253 ,  G06F17/30091 ,  G06F17/30185 ,  G06F2212/7205

Abstract: The disclosed embodiments relate to the design of an append-only data storage system that stores sets of data blocks in extents that are located in storage devices in the system. During operation of the system, when an extent becomes full, the system changing the extent from an open state, wherein data can be appended to the extent, to a closed state, wherein data cannot be appended to the extent. Changing the extent from the open state to the closed state includes performing the following operations at one or more storage devices that contain copies of the extent: constructing an index to facilitate accessing data blocks in a copy of the extent contained in the storage device; and appending the index to the copy of the extent in non-volatile storage in the storage device.

Abstract translation: 所公开的实施例涉及仅在位于系统中的存储设备中的盘区中存储数据块集合的仅追加数据存储系统的设计。 在系统操作期间，当一个档位变满时，该系统将数据从该打开状态改变到一个关闭状态，其中数据不能被附加到该程度。 改变从打开状态到关闭状态的程度包括在包含该范围的副本的一个或多个存储设备处执行以下操作：构建索引以便于访问存储设备中包含的范围的副本中的数据块; 并将索引附加到存储设备中的非易失性存储中的扩展区的副本。

公开(公告)号：US20160092124A1

公开(公告)日：2016-03-31

申请号：US14497195

申请日：2014-09-25

Applicant: Dropbox, Inc.

Inventor： James Cowling ,  James Turner

IPC: G06F3/06

CPC classification number: G06F3/0619 ,  G06F3/0611 ,  G06F3/064 ,  G06F3/065 ,  G06F3/0655 ,  G06F3/067 ,  G06F3/0688

Abstract: The disclosed embodiments relate to the design of an append-only data storage system that stores sets of data blocks in extents that are located in storage devices in the system. During operation of the system, when an extent is in an open state, the system allows data blocks to be appended to the extent, and disallows operations to be performed on the extent that are incompatible with data being concurrently appended to the extent. When the extent becomes full, the system changes the extent from the open state to a closed state. Then, while the extent is in the closed state, the system disallows data blocks to be appended to the extent, and allows operations to be performed on the extent that are incompatible with data being concurrently appended to the extent.

Abstract translation: 所公开的实施例涉及仅在位于系统中的存储设备中的盘区中存储数据块集合的仅追加数据存储系统的设计。 在系统操作期间，当一个盘区处于打开状态时，该系统允许将数据块附加到该盘区，并且不允许在不兼容同时附加到该盘区的数据的情况下执行操作。 当范围变满时，系统将从打开状态改变到关闭状态。 然后，当该范围处于关闭状态时，系统不允许将数据块附加到该范围，并允许在与同时附加到该范围的数据不兼容的程度上执行操作。

公开(公告)号：US20160147569A1

公开(公告)日：2016-05-26

申请号：US14555101

申请日：2014-11-26

Applicant: Dropbox, Inc.

Inventor： James Cowling ,  James Turner

IPC: G06F9/50

CPC classification number: G06F3/067 ,  G06F9/5027 ,  G06F17/30312

Abstract: A distributed computing system that executes a set of long-lived jobs is described. During operation, each worker process performs the following operations. First, the worker process identifies a set of jobs to be executed and a set of worker processes that can execute the set of jobs. Next, the worker process sorts the set of worker processes based on unique identifiers for the worker processes. Then, the worker process assigns jobs to each worker process in the set of worker processes, wherein approximately the same number of jobs is assigned to each worker process, and jobs are assigned to the worker processes in sorted order. While assigning jobs, the worker process uses an identifier for each worker process to seed a pseudorandom number generator, and then uses the pseudorandom number generator to select jobs for each worker process to execute.

Abstract translation: 描述执行一组长寿命作业的分布式计算系统。 在操作期间，每个工作进程执行以下操作。 首先，工作进程标识要执行的一组作业和一组可以执行作业的工作进程。 接下来，工作进程根据工作进程的唯一标识符对工作进程集进行排序。 然后，工作进程将作业分配给一组工作进程中的每个工作进程，其中大约相同数量的作业分配给每个工作进程，作业按排序顺序分配给工作进程。 在分配作业时，工作进程使用每个工作进程的标识符来种子伪随机数生成器，然后使用伪随机数生成器为每个要执行的工作进程选择作业。

公开(公告)号：US20160110109A1

公开(公告)日：2016-04-21

申请号：US14519907

申请日：2014-10-21

Applicant: Dropbox, Inc.

Inventor： James Cowling ,  James Turner

IPC: G06F3/06 ,  G06F12/02

CPC classification number: G06F3/065 ,  G06F3/0608 ,  G06F3/0623 ,  G06F3/067 ,  G06F12/023 ,  G06F2212/254

Abstract: An append-only data storage system is described that stores sets of data blocks in extents that are located in storage devices. During operation of the system, upon receiving a request to copy an extent from a source storage device to a destination storage device, the system creates a scratch extent on the destination storage device, and associates the scratch extent with a private identifier, whereby the scratch extent can only be accessed through the private identifier. The system uses the private identifier to perform a copying operation that copies the extent from the source storage device to the scratch extent on the destination storage device. After the copying operation is complete and the scratch extent is closed, the system associates the scratch extent with a public identifier, whereby the copy of the extent on the destination storage device becomes publically accessible to other entities in the data storage system.

Abstract translation: 描述了仅附加数据存储系统，其存储位于存储设备中的扩展区中的数据块集合。 在系统操作期间，当接收到从源存储设备向目标存储设备复制范围的请求时，系统在目的地存储设备上创建临时区段，并将临时区段与私有标识符相关联，由此划伤 范围只能通过私有标识符访问。 该系统使用专用标识符执行复制操作，该操作将来自源存储设备的扩展区域复制到目标存储设备上的临时区域。 在复制操作完成并且临时区段关闭之后，系统将临时区段与公共标识符相关联，由此目的地存储设备上的区段的副本可以公开地访问数据存储系统中的其他实体。