公开(公告)号：US08006111B1

公开(公告)日：2011-08-23

申请号：US11859100

申请日：2007-09-21

Applicant: Sorin Faibish ,  Peter Bixby ,  Percy Tzelnic

Inventor： Sorin Faibish ,  Peter Bixby ,  Percy Tzelnic

IPC: G06F1/32

CPC classification number: G06F3/0625 ,  G06F1/3221 ,  G06F1/3268 ,  G06F1/3287 ,  G06F3/0649 ,  G06F3/067 ,  G06F17/30147 ,  Y02D10/154 ,  Y02D10/171

Abstract: A file server includes active storage containing frequently accessed files, and active/inactive disk drives for containing infrequently accessed files. Groups of the files having become inactive in the active storage are successively migrated to respective evacuated active/inactive disk drives so that each active/inactive disk drive is loaded with files having a similar probability of access when access to the active/inactive disk drive reaches an inactivity threshold for powering down the active/inactive disk drive. Storage of the active/inactive disk drives is reclaimed when an oldest group of the files is archived or when an active/inactive disk drive is evacuated by migrating files from the active/inactive disk drive to storage having been released in other disk drives by promotion of files for client access to the promoted files. Therefore, recovery of storage can be planned and scheduled in advance and performed efficiently in a background process.

Abstract translation: 文件服务器包括包含经常访问的文件的活动存储器，以及用于包含不经常访问的文件的主动/非活动磁盘驱动器。 在活动存储器中变得不活动的文件组被依次迁移到相应的撤离的活动/非活动磁盘驱动器，使得当访问活动/非活动磁盘驱动器到达时，每个活动/非活动磁盘驱动器被加载具有相似的访问概率的文件 用于关闭主动/非活动磁盘驱动器的非活动阈值。 当归档最旧的文件组或通过将活动/非活动磁盘驱动器中的文件迁移到已经通过宣传释放到其他磁盘驱动器中的存储而将主动/不活动磁盘驱动器撤离时，将回收活动/非活动磁盘驱动器的存储 的文件，以便客户端访问升级的文件。 因此，可以预先规划和调度存储的恢复并且在后台进程中有效地执行。

公开(公告)号：US09165014B1

公开(公告)日：2015-10-20

申请号：US13536358

申请日：2012-06-28

Applicant: Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Aaron Torres

Inventor： Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Aaron Torres

IPC: G06F17/30

CPC classification number: G06F17/30215 ,  G06F17/30244

Abstract: Techniques are provided for storing files in a parallel computing system using different resolutions. A method is provided for storing at least one file generated by a distributed application in a parallel computing system. The file comprises one or more of a complete file and a sub-file. The method comprises the steps of obtaining semantic information related to the file; generating a plurality of replicas of the file with different resolutions based on the semantic information; and storing the file and the plurality of replicas of the file in one or more storage nodes of the parallel computing system. The different resolutions comprise, for example, a variable number of bits and/or a different sub-set of data elements from the file. A plurality of the sub-files can be merged to reproduce the file.

Abstract translation: 提供了使用不同分辨率在并行计算系统中存储文件的技术。 提供了一种用于将由分布式应用生成的至少一个文件存储在并行计算系统中的方法。 该文件包括完整文件和子文件中的一个或多个。 该方法包括获取与文件相关的语义信息的步骤; 基于语义信息生成具有不同分辨率的文件的多个副本; 以及将所述文件的文件和所述多个副本存储在所述并行计算系统的一个或多个存储节点中。 不同的分辨率例如包括来自文件的可变数量的位和/或不同的数据元素子集。 可以合并多个子文件以再现该文件。

公开(公告)号：US09087075B1

公开(公告)日：2015-07-21

申请号：US13536331

申请日：2012-06-28

Applicant: Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Zhenhua Zhang ,  Gary Grider

Inventor： Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Zhenhua Zhang ,  Gary Grider

IPC: G06F17/30

CPC classification number: G06F17/30212

Abstract: Improved techniques are provided for storing files in a parallel computing system using a list-based index to identify file replicas. A file and at least one replica of the file are stored in one or more storage nodes of the parallel computing system. An index for the file comprises at least one list comprising a pointer to a storage location of the file and a storage location of the at least one replica of the file. The file comprises one or more of a complete file and one or more sub-files. The index may also comprise a checksum value for one or more of the file and the replica(s) of the file. The checksum value can be evaluated to validate the file and/or the file replica(s). A query can be processed using the list.

Abstract translation: 提供了改进的技术，用于使用基于列表的索引来在并行计算系统中存储文件以识别文件副本。 文件和文件的至少一个副本存储在并行计算系统的一个或多个存储节点中。 文件的索引包括至少一个列表，其包括指向文件的存储位置的指针和该文件的至少一个副本的存储位置。 该文件包括完整文件和一个或多个子文件中的一个或多个。 索引还可以包括文件中的一个或多个文件和文件副本的校验和值。 可以评估校验和值以验证文件和/或文件副本。 可以使用列表处理查询。

公开(公告)号：US08719590B1

公开(公告)日：2014-05-06

申请号：US13525919

申请日：2012-06-18

Applicant: Sorin Faibish ,  Percy Tzelnic

Inventor： Sorin Faibish ,  Percy Tzelnic

IPC: G06F12/14

CPC classification number: H04L63/0428 ,  G06F21/10 ,  G06F21/602 ,  G06F2221/0748 ,  H04L9/085 ,  H04L9/0894 ,  H04L12/4641 ,  H04L67/10

Abstract: Cloud infrastructure of an information processing system comprises one or more processing devices implementing a plurality of virtual machines. The cloud infrastructure is configured to receive a processing job from a tenant, to obtain a first key specific to the tenant, to determine a second key utilizing information supplied by the tenant, and to encrypt one or more results of the processing job utilizing a combination of the first key and the second key. At least a portion of the second key is determined by at least one application that is run on at least one virtual machine of the cloud infrastructure in conjunction with performance of the processing job. The encrypted results of the processing job may be stored in a virtual memory of the cloud infrastructure and transmitted to the tenant.

Abstract translation: 信息处理系统的云基础设施包括实现多个虚拟机的一个或多个处理设备。 云基础架构被配置为从租户接收处理作业，以获得租户特有的第一密钥，以利用租户提供的信息来确定第二密钥，并且利用组合来加密处理作业的一个或多个结果 的第一个键和第二个键。 结合执行处理作业，由至少一个在云基础设施的一个虚拟机上运行的应用程序确定第二个密钥的至少一部分。 处理作业的加密结果可以存储在云基础设施的虚拟存储器中并被传送给租户。

公开(公告)号：US08949255B1

公开(公告)日：2015-02-03

申请号：US13536384

申请日：2012-06-28

Applicant: Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Aaron Torres

Inventor： Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Aaron Torres

IPC: G06F17/30

CPC classification number: G06F17/301

Abstract: Techniques are provided for storing files in a parallel computing system using sub-files with semantically meaningful boundaries. A method is provided for storing at least one file generated by a distributed application in a parallel computing system. The file comprises one or more of a complete file and a plurality of sub-files. The method comprises the steps of obtaining a user specification of semantic information related to the file; providing the semantic information as a data structure description to a data formatting library write function; and storing the semantic information related to the file with one or more of the sub-files in one or more storage nodes of the parallel computing system. The semantic information provides a description of data in the file. The sub-files can be replicated based on semantically meaningful boundaries.

Abstract translation: 提供了使用具有语义有意义的边界的子文件在并行计算系统中存储文件的技术。 提供了一种用于将由分布式应用生成的至少一个文件存储在并行计算系统中的方法。 该文件包括完整文件和多个子文件中的一个或多个。 该方法包括以下步骤：获得与文件相关的语义信息的用户指定; 提供语义信息作为数据格式化库写入功能的数据结构描述; 以及将与所述文件相关的所述语义信息与所述子文件中的一个或多个存储在所述并行计算系统的一个或多个存储节点中。 语义信息提供文件中数据的描述。 子文件可以基于语义有意义的边界进行复制。

公开(公告)号：US08868576B1

公开(公告)日：2014-10-21

申请号：US13536369

申请日：2012-06-28

Applicant: Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Adam Manzanares ,  Aaron Torres

Inventor： Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Adam Manzanares ,  Aaron Torres

IPC: G06F17/30

CPC classification number: G06F17/3056 ,  G06F17/30091

Abstract: Techniques are provided for storing files in a parallel computing system based on a user-specified parser function. A plurality of files generated by a distributed application in a parallel computing system are stored by obtaining a parser from the distributed application for processing the plurality of files prior to storage; and storing one or more of the plurality of files in one or more storage nodes of the parallel computing system based on the processing by the parser. The plurality of files comprise one or more of a plurality of complete files and a plurality of sub-files. The parser can optionally store only those files that satisfy one or more semantic requirements of the parser. The parser can also extract metadata from one or more of the files and the extracted metadata can be stored with one or more of the plurality of files and used for searching for files.

Abstract translation: 提供了用于基于用户指定的解析器功能在并行计算系统中存储文件的技术。 由并行计算系统中的分布式应用程序生成的多个文件通过从分布式应用程序获得解析器来存储，用于在存储之前处理多个文件; 以及基于所述解析器的处理，将所述多个文件中的一个或多个存储在所述并行计算系统的一个或多个存储节点中。 多个文件包括多个完整文件和多个子文件中的一个或多个。 解析器可以可选地仅存储满足解析器的一个或多个语义要求的那些文件。 解析器还可以从一个或多个文件中提取元数据，并且所提取的元数据可以与多个文件中的一个或多个文件一起存储并用于搜索文件。

公开(公告)号：US08825652B1

公开(公告)日：2014-09-02

申请号：US13536315

申请日：2012-06-28

Applicant: Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Jingwang Zhang

Inventor： Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Jingwang Zhang

IPC: G06F17/30

CPC classification number: G06F17/302

Abstract: Techniques are provided for small file aggregation in a parallel computing system. An exemplary method for storing a plurality of files generated by a plurality of processes in a parallel computing system comprises aggregating the plurality of files into a single aggregated file; and generating metadata for the single aggregated file. The metadata comprises an offset and a length of each of the plurality of files in the single aggregated file. The metadata can be used to unpack one or more of the files from the single aggregated file.

Abstract translation: 在并行计算系统中提供了用于小文件聚合的技术。 用于存储由并行计算系统中的多个进程生成的多个文件的示例性方法包括将所述多个文件聚合成单个聚合文件; 并为单个聚合文件生成元数据。 元数据包括单个聚合文件中的多个文件中的每一个的偏移量和长度。 元数据可用于从单个聚合文件中解压缩一个或多个文件。

公开(公告)号：US5893140A

公开(公告)日：1999-04-06

申请号：US747631

申请日：1996-11-13

Applicant: Uresh K Vahalia ,  Uday Gupta ,  Betti Porat ,  Percy Tzelnic

Inventor： Uresh K Vahalia ,  Uday Gupta ,  Betti Porat ,  Percy Tzelnic

IPC: G06F11/14 ,  G06F12/08 ,  G06F17/30 ,  H04L29/08 ,  G06F12/00

CPC classification number: G06F17/30171 ,  G06F11/1435 ,  G06F12/0804 ,  G06F12/0813 ,  G06F12/0866 ,  H04L67/1095 ,  Y10S706/908

Abstract: A conventional network file server has a file system that permits file attributes and file data to be written in any order. The conventional network file server may also support an asynchronous write protocol, in which file attributes and file data need not be written to disk storage until a client sends a commit request. This asynchronous write protocol has a data security problem if the attributes are written before the data and the server crashes before completing the writing of the data to disk storage. This security problem is solved by adding a file system cache and following a protocol that writes the attributes to storage after writing the data to storage. For example, the attributes and data are stored in the file system cache and are not written down to storage until receipt of a commit request. When the commit request is received, the data is sent first from the file system cache to storage. Then the attributes are sent from the file system cache to storage. Then the file server acknowledges completion of the commit operation. In a preferred embodiment, storage is provided by an integrated cached disk array (ICDA) having a buffer cache and an array of disk drives, and the file system cache is distributed in a plurality of data mover computers interfaced to the ICDA. The addition of the file system cache to solve the security problem also reduces the burden on the buffer cache in the ICDA.

Abstract translation: 传统的网络文件服务器具有允许以任何顺序写入文件属性和文件数据的文件系统。 传统的网络文件服务器还可以支持异步写入协议，其中文件属性和文件数据不需要写入磁盘存储器，直到客户端发送提交请求。 如果在完成将数据写入磁盘存储器之前，数据之前写入的属性和服务器崩溃，则此异步写入协议有数据安全问题。 通过添加文件系统缓存并在将数据写入存储后遵循将属性写入存储的协议来解决此安全问题。 例如，属性和数据存储在文件系统缓存中，并且不会被写入存储，直到收到提交请求。 收到提交请求后，首先将数据从文件系统缓存发送到存储。 然后将属性从文件系统缓存发送到存储。 然后文件服务器确认完成提交操作。 在优选实施例中，通过具有缓冲高速缓存和磁盘驱动器阵列的集成缓存磁盘阵列（ICDA）提供存储，并且文件系统高速缓存分布在与ICDA接口的多个数据移动器计算机中。 加上文件系统缓存来解决安全问题，也减轻了ICDA缓冲区高速缓存的负担。

公开(公告)号：US5528513A

公开(公告)日：1996-06-18

申请号：US148114

申请日：1993-11-04

Applicant: Lev Vaitzblit ,  Kadangode K. Ramakrishnan ,  Percy Tzelnic

Inventor： Lev Vaitzblit ,  Kadangode K. Ramakrishnan ,  Percy Tzelnic

IPC: H04L29/06 ,  H04L29/08 ,  H04N7/173 ,  G06F15/20

CPC classification number: H04L65/80 ,  H04L29/06027 ,  H04L67/322 ,  H04L67/325 ,  H04L69/329 ,  H04N7/17336

Abstract: A scheduler with admissions control in a continuous media file server is presented. The scheduler supports multiple classes of tasks with diverse performance requirements. The scheduler is based on a combination of rate-monotonic and weighted round-robin scheduling schemes. Scheduling is accomplished in a hierarchical manner. Isochronous tasks have the highest priority and are scheduled first followed by real-time and general-purpose tasks. Isochronous tasks run periodically and are invoked by a timer interrupt set for each task. After scheduling the isochronous tasks, the scheduler alternates between the real-time tasks and the general-purpose tasks using a weighted round-robin scheme.

Abstract translation: 介绍了一种在连续媒体文件服务器中具有入口控制的调度器。 调度程序支持具有不同性能要求的多类任务。 调度器基于速率单调和加权循环调度方案的组合。 调度以分级方式完成。 同步任务具有最高优先级，并且首先安排，之后是实时和通用任务。 同步任务周期性运行，并由每个任务的定时器中断集调用。 在调度同步任务之后，调度器使用加权循环方案在实时任务和通用任务之间交替。

公开(公告)号：US07739379B1

公开(公告)日：2010-06-15

申请号：US10871600

申请日：2004-06-18

Applicant: Uresh K. Vahalia ,  Uday Gupta ,  Betti Porat ,  Percy Tzelnic

Inventor： Uresh K. Vahalia ,  Uday Gupta ,  Betti Porat ,  Percy Tzelnic

IPC: G06F15/16 ,  G06F15/167 ,  G06F15/173

CPC classification number: G06F17/30171

Abstract: A network file server includes a first set of data processors for receiving requests from clients, and a second set of data processors for accessing read-write file systems. A respective data processor in the second set is assigned to each file system for exclusive management of read and write locks on the file system. Each data processor in the first set can authorize access to file systems directly accessed by more than one data processor in the second set. Processing of a request for access that is authorized is continued by the data processor that is assigned to manage the locks on the file system to be accessed. The exclusivity of lock management eliminates cache coherency problems, and dynamic load balancing can be used to prevent the lock management from becoming a bottleneck to performance. A preferred embodiment includes a cached disk storage subsystem linked to data mover computers. Each data mover has authorization and ownership information for a plurality of file systems, and maintains a local cache of locking information for file systems that the data mover can directly access. The data mover receives a client request, and if access is authorized, checks whether it can directly access the file, and if not, forwards the request to another data mover.

Abstract translation: 网络文件服务器包括用于接收来自客户端的请求的第一组数据处理器和用于访问读写文件系统的第二组数据处理器。 第二组中的相应数据处理器被分配给每个文件系统，用于对文件系统上的读取和写入锁定进行排他性管理。 第一组中的每个数据处理器可以授权访问由第二组中的多个数据处理器直接访问的文件系统。 被授权的访问请求的处理由被分配用于管理要访问的文件系统上的锁的数据处理器继续。 锁管理的排他性消除了缓存一致性问题，动态负载平衡可以用来防止锁管理成为性能的瓶颈。 优选实施例包括链接到数据移动器计算机的高速缓存的磁盘存储子系统。 每个数据移动器具有用于多个文件系统的授权和所有权信息，并维护数据移动者可以直接访问的文件系统的锁定信息的本地缓存。 数据移动器接收客户端请求，如果访问被授权，则检查它是否可以直接访问该文件，如果不是，则将该请求转发给另一个数据移动器。