公开(公告)号：US08825652B1

公开(公告)日：2014-09-02

申请号：US13536315

申请日：2012-06-28

Applicant: Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Jingwang Zhang

Inventor： Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Jingwang Zhang

IPC: G06F17/30

CPC classification number: G06F17/302

Abstract: Techniques are provided for small file aggregation in a parallel computing system. An exemplary method for storing a plurality of files generated by a plurality of processes in a parallel computing system comprises aggregating the plurality of files into a single aggregated file; and generating metadata for the single aggregated file. The metadata comprises an offset and a length of each of the plurality of files in the single aggregated file. The metadata can be used to unpack one or more of the files from the single aggregated file.

Abstract translation: 在并行计算系统中提供了用于小文件聚合的技术。 用于存储由并行计算系统中的多个进程生成的多个文件的示例性方法包括将所述多个文件聚合成单个聚合文件; 并为单个聚合文件生成元数据。 元数据包括单个聚合文件中的多个文件中的每一个的偏移量和长度。 元数据可用于从单个聚合文件中解压缩一个或多个文件。

公开(公告)号：US08819344B1

公开(公告)日：2014-08-26

申请号：US11836735

申请日：2007-08-09

Applicant: Sorin Faibish ,  Per Brashers ,  James Pedone ,  Jason Glasgow ,  Xiaoye Jiang

Inventor： Sorin Faibish ,  Per Brashers ,  James Pedone ,  Jason Glasgow ,  Xiaoye Jiang

IPC: G06F12/10

CPC classification number: G06F3/0689 ,  G06F3/061 ,  G06F3/064 ,  G06F3/0659 ,  G06F3/067 ,  G06F11/1076

Abstract: A data processing system includes host data processors, a data storage system including data storage shared among the host data processors, and a data switch coupling the host data processors to the data storage system. The data storage system has host adapter ports coupled to the data switch. The data switch is programmed for distributing block I/O requests from the host data processors over the operable host adapter ports for load balancing of the block I/O requests among the operable host adapter ports. The shared data storage can be a file system striped across RAID sets of disk drives for load balancing upon disk director ports of the data storage system. The data processing system can be expanded by adding more data storage systems, switches for the additional data storage systems, and switches for routing block I/O requests from the host processors to the data storage systems.

Abstract translation: 数据处理系统包括主机数据处理器，包括在主机数据处理器之间共享的数据存储器的数据存储系统以及将主机数据处理器耦合到数据存储系统的数据交换机。 数据存储系统具有耦合到数据交换机的主机适配器端口。 数据交换机被编程为通过可操作的主机适配器端口从主机数据处理器分发块I / O请求，以便在可操作的主机适配器端口之间进行块I / O请求的负载平衡。 共享数据存储可以是跨RAID磁盘阵列分割的文件系统，用于在数据存储系统的磁盘导向器端口上进行负载平衡。 可以通过添加更多的数据存储系统，用于附加数据存储系统的交换机和用于将块I / O请求从主机处理器路由到数据存储系统的交换机来扩展数据处理系统。

公开(公告)号：US08805951B1

公开(公告)日：2014-08-12

申请号：US13022946

申请日：2011-02-08

Applicant: Sorin Faibish ,  Jeffrey M. Nick

Inventor： Sorin Faibish ,  Jeffrey M. Nick

IPC: G06F15/167

CPC classification number: G06F9/5072 ,  G06F21/6218 ,  H04L63/04

Abstract: An application is included in a virtual machine sent to a cloud computing server. The cloud computing server has a remote access layer that fetches data blocks of the private dataset of the application from private data storage as the data blocks are requested by the application, so that the application in the public cloud begins execution without waiting for the entire application dataset to be transferred to the public cloud, and the data blocks are transferred from the private dataset to the public cloud only when the data blocks are accessed by the application. The application's private data is kept in the public cloud only when it is currently being used. If there are security concerns, the application's private data is transferred over the public network in an encrypted form and stored in the public cloud in an encrypted form.

Abstract translation: 应用程序包含在发送到云计算服务器的虚拟机中。 云计算服务器具有一个远程访问层，当应用程序请求数据块时，从专用数据存储中取出应用程序的私有数据集的数据块，从而公共云中的应用程序开始执行，而无需等待整个应用程序 数据集转移到公共云中，只有当应用程序访问数据块时，数据块才会从私有数据集传输到公共云。 应用程序的私有数据仅在当前正在使用时才会保留在公共云中。 如果存在安全问题，应用程序的私有数据将以加密形式通过公共网络传输，并以加密形式存储在公共云中。

公开(公告)号：US08776158B1

公开(公告)日：2014-07-08

申请号：US12570685

申请日：2009-09-30

Applicant: Dominique Cote ,  Xiaoye Jiang ,  Sorin Faibish

Inventor： Dominique Cote ,  Xiaoye Jiang ,  Sorin Faibish

IPC: H04N7/173 ,  H04N21/232 ,  H04N21/231

CPC classification number: H04N21/232 ,  H04N21/23106 ,  H04N21/2323 ,  H04N21/23406

Abstract: Three contiguous segments of video data are kept in video cache memory for streaming video data to a host application from a video file in data storage. For example, three buffers are allocated in the cache memory for each video stream, and at any given time during sequential access, a particular one of the three buffers is a middle buffer from which pre-fetched data is streamed to the host application. For forward or backward streaming, the buffers also include a backward buffer as well as a forward buffer on opposite sides of the middle buffer. In order to simplify the assembling of the buffers, a shift or rotation of the roles of the buffers and an asynchronous pre-fetch for continuance of a stream or for a switched direction of a stream is triggered by the cache state of the offset requested by the video application.

Abstract translation: 三个连续的视频数据段保存在视频高速缓冲存储器中，用于将视频数据从数据存储中的视频文件传输到主机应用。 例如，在每个视频流的高速缓冲存储器中分配三个缓冲器，并且在顺序访问期间的任何给定时间，三个缓冲器中的特定一个缓冲器是中间缓冲器，预取数据从该中间缓冲器流传送到主机应用。 对于前向或后向流，缓冲器还包括向后缓冲器以及在中间缓冲器的相对侧上的前向缓冲器。 为了简化缓冲器的组合，缓冲器的角色的移位或旋转以及用于流的连续或用于流的切换方向的异步预取是由所请求的偏移的高速缓存状态触发的 视频应用程序。

公开(公告)号：US07945726B2

公开(公告)日：2011-05-17

申请号：US11382075

申请日：2006-05-08

Applicant: Sorin Faibish ,  Stephen A. Fridella ,  Xiaoye Jiang ,  Uday K. Gupta

Inventor： Sorin Faibish ,  Stephen A. Fridella ,  Xiaoye Jiang ,  Uday K. Gupta

IPC: G06F12/00

CPC classification number: G06F3/0665 ,  G06F3/061 ,  G06F3/067

Abstract: In a data processing system, a first processor pre-allocates data blocks for use in a file system at a later time when a second processor needs data blocks for extending the file system. The second processor selectively maps the logical addresses of the pre-allocated blocks so that when the pre-allocated blocks are used in the file system, the layout of the file system on disk is improved to avoid block scatter and enhance I/O performance. The selected mapping can be done at a program layer between a conventional file system manager and a conventional logical volume layer so that there is no need to modify the data block mapping mechanism of the file system manager or the logical volume layer. The data blocks can be pre-allocated adaptively in accordance with the allocation history of the file system.

Abstract translation: 在数据处理系统中，当第二处理器需要用于扩展文件系统的数据块时，第一处理器在稍后的时间预分配用于文件系统的数据块。 第二处理器选择性地映射预分配块的逻辑地址，使得当在文件系统中使用预先分配的块时，改进了盘上的文件系统的布局，以避免块散射和增强I / O性能。 所选择的映射可以在常规文件系统管理器和常规逻辑卷层之间的程序层完成，使得不需要修改文件系统管理器或逻辑卷层的数据块映射机制。 数据块可以根据文件系统的分配历史自适应地预分配。

公开(公告)号：US07930487B1

公开(公告)日：2011-04-19

申请号：US11854616

申请日：2007-09-13

Applicant: Sorin Faibish ,  Per Brashers ,  Jason Glasgow

Inventor： Sorin Faibish ,  Per Brashers ,  Jason Glasgow

IPC: G06F12/00

CPC classification number: G06F21/805

Abstract: An access control agent is advantageously deployed at a host device to prevent malicious use of a storage system by unauthorized hosts and users. In one embodiment the access control agent is disposed in a processing path between the application and the storage device. An application is mounted as an image file by a loop device to provide a virtual file system. The virtual file system is populated with access control information for each block of the file. Application I/O requests are mapped to physical blocks of the storage by the loop device, and the access control information is used to filter the access requests to preclude unauthorized requests from being forwarded to the storage client (and consequently the storage devices). With such an arrangement, access rights can be determined at I/O accesses, file and block granularity for each user.

Abstract translation: 访问控制代理有利地部署在主机设备中，以防止未经授权的主机和用户恶意使用存储系统。 在一个实施例中，访问控制代理被布置在应用程序和存储设备之间的处理路径中。 应用程序通过循环设备作为映像文件安装，以提供虚拟文件系统。 虚拟文件系统填充有文件的每个块的访问控制信息。 应用程序I / O请求被环路设备映射到存储的物理块，并且访问控制信息用于过滤访问请求，以防止未经授权的请求被转发到存储客户端（以及因此存储设备）。 通过这样的安排，可以在I / O访问，每个用户的文件和块粒度上确定访问权限。

公开(公告)号：US07555504B2

公开(公告)日：2009-06-30

申请号：US10668546

申请日：2003-09-23

Applicant: Peter Bixby ,  Sachin Mullick ,  Jiannan Zheng ,  Xiaoye Jiang ,  Sorin Faibish

Inventor： Peter Bixby ,  Sachin Mullick ,  Jiannan Zheng ,  Xiaoye Jiang ,  Sorin Faibish

IPC: G06F17/30

CPC classification number: G06F17/30088 ,  Y10S707/99953 ,  Y10S707/99954

Abstract: Read-only and read-write snapshot copies of a production file in a Unix-based file system are organized as a version set of file inodes and shared file blocks. Version pointers and branch pointers link the inodes. Initially the production file can have all its blocks preallocated or it can be a sparse file having only an inode and its last data block. A protocol is provided for creating read-only and read-write snapshots, deleting snapshots, restoring the production file with a specified snapshot, refreshing a specified snapshot, and naming the snapshots. Block pointers are marked with a flag indicating whether or not the pointed-to block is owned by the parent inode. A non-owner marking is inherited by all of the block's descendants. The block ownership controls the copying of indirect blocks when writing to the production file, and also controls deallocation and passing of blocks when deleting a read-only snapshot.

Abstract translation: 基于Unix的文件系统中的生产文件的只读和读写快照副本被组织为文件inode和共享文件块的版本集。 版本指针和分支指针链接inode。 最初，生产文件可以预先分配其所有块，也可以是只有一个inode及其最后一个数据块的稀疏文件。 提供了一种协议，用于创建只读和读写快照，删除快照，使用指定的快照还原生产文件，刷新指定的快照以及命名快照。 块指针标有一个标志，指示指向块是否由父节点所拥有。 非所有者标记由所有块的后代继承。 块所有权控制在写入生产文件时复制间接块，并在删除只读快照时控制块的释放和传递。

公开(公告)号：US07412496B2

公开(公告)日：2008-08-12

申请号：US10645976

申请日：2003-08-22

Applicant: Stephen A Fridella ,  Gang Ma ,  Xiaoye Jiang ,  Sorin Faibish ,  Rui Liang

Inventor： Stephen A Fridella ,  Gang Ma ,  Xiaoye Jiang ,  Sorin Faibish ,  Rui Liang

IPC: G06F15/16 ,  G06F15/173

CPC classification number: G06F17/30067

Abstract: To permit multiple unsynchronized processors to update the file-modification time attribute of a file during concurrent asynchronous writes to the file, a primary processor having a clock manages access to metadata of the file. A number of secondary processors service client request for access to the file. Each secondary processor has a timer. When the primary processor grants a range lock upon the file to a secondary, it returns its clock time (m). Upon receipt, the secondary starts a local timer (t). When the secondary modifies the file data, it determines a file-modification time that is a function of the clock time and the timer interval, such as a sum (m+t). When the secondary receives an updated file-modification time (mp) from the primary, if mp>m+t, then the secondary updates the clock time (m) to (mp) and resets its local timer.

Abstract translation: 为了允许多个不同步处理器在并发异步写入文件期间更新文件的文件修改时间属性，具有时钟的主处理器管理对文件的元数据的访问。 一些次要处理器服务客户端请求访问该文件。 每个二级处理器都有一个定时器。 当主处理器向文件夹授予范围锁定时，它返回其时钟时间（m）。 收到后，辅助启动本地计时器（t）。 当二次修改文件数据时，它确定作为时钟时间和定时器间隔的函数的文件修改时间，例如和（m + t）。 当辅助节点从主节点接收到更新的文件修改时间（mp）时，如果mp> m + t，则辅助节点将时钟（m）更新为（mp），并重置其本地定时器。

公开(公告)号：US20070260842A1

公开(公告)日：2007-11-08

申请号：US11382075

申请日：2006-05-08

Applicant: Sorin Faibish ,  Stephen Fridella ,  Xiaoye Jiang ,  Uday Gupta

Inventor： Sorin Faibish ,  Stephen Fridella ,  Xiaoye Jiang ,  Uday Gupta

IPC: G06F12/00

CPC classification number: G06F3/0665 ,  G06F3/061 ,  G06F3/067

Abstract: In a data processing system, a first processor pre-allocates data blocks for use in a file system at a later time when a second processor needs data blocks for extending the file system. The second processor selectively maps the logical addresses of the pre-allocated blocks so that when the pre-allocated blocks are used in the file system, the layout of the file system on disk is improved to avoid block scatter and enhance I/O performance. The selected mapping can be done at a program layer between a conventional file system manager and a conventional logical volume layer so that there is no need to modify the data block mapping mechanism of the file system manager or the logical volume layer. The data blocks can be pre-allocated adaptively in accordance with the allocation history of the file system.

Abstract translation: 在数据处理系统中，当第二处理器需要用于扩展文件系统的数据块时，第一处理器在稍后的时间预分配用于文件系统的数据块。 第二处理器选择性地映射预分配块的逻辑地址，使得当在文件系统中使用预先分配的块时，改进了盘上的文件系统的布局，以避免块散射和增强I / O性能。 所选择的映射可以在常规文件系统管理器和常规逻辑卷层之间的程序层完成，使得不需要修改文件系统管理器或逻辑卷层的数据块映射机制。 数据块可以根据文件系统的分配历史自适应地预分配。

公开(公告)号：US07174561B2

公开(公告)日：2007-02-06

申请号：US09834427

申请日：2001-04-13

Applicant: Peter Bixby ,  John Forecast ,  William O. Hultin ,  Sorin Faibish ,  Wayne W. Duso

Inventor： Peter Bixby ,  John Forecast ,  William O. Hultin ,  Sorin Faibish ,  Wayne W. Duso

IPC: H04N7/173

CPC classification number: H04N21/23424 ,  H04N21/44016

Abstract: A system for producing multiple concurrent real-time video streams from stored MPEG video clips includes a video server and at least one MPEG decoder array. The decoder array has multiple decoder pairs, each pair having a video switch for switching from one decoder in the pair to the other at a specified time. Switching may occur from a specified Out-point frame to a specified In-point frame, and the specified frames can be any frame type at any location in the group of pictures (GOP) structure. In a preferred construction, the video server has a controller server linked to a series of data mover computers, each controlling one or more respective decoder arrays. The data mover computers use a control protocol to control the decoder arrays, and each decoder uses a data protocol to request data from a respective data mover computer.

Abstract translation: 用于从存储的MPEG视频剪辑产生多个并发实时视频流的系统包括视频服务器和至少一个MPEG解码器阵列。 解码器阵列具有多个解码器对，每对具有用于在指定时间从一对解码器切换到另一个的视频切换器。 可以从指定的Out-Point帧到指定的In-point帧进行切换，并且指定的帧可以是图像组（GOP）结构中的任何位置处的任何帧类型。 在优选结构中，视频服务器具有链接到一系列数据移动器计算机的控制器服务器，每个数据移动器计算机控制一个或多个相应的解码器阵列。 数据移动器计算机使用控制协议来控制解码器阵列，并且每个解码器使用数据协议来从相应的数据移动器计算机请求数据。