公开(公告)号：US08006111B1

公开(公告)日：2011-08-23

申请号：US11859100

申请日：2007-09-21

Applicant: Sorin Faibish ,  Peter Bixby ,  Percy Tzelnic

Inventor： Sorin Faibish ,  Peter Bixby ,  Percy Tzelnic

IPC: G06F1/32

CPC classification number: G06F3/0625 ,  G06F1/3221 ,  G06F1/3268 ,  G06F1/3287 ,  G06F3/0649 ,  G06F3/067 ,  G06F17/30147 ,  Y02D10/154 ,  Y02D10/171

Abstract: A file server includes active storage containing frequently accessed files, and active/inactive disk drives for containing infrequently accessed files. Groups of the files having become inactive in the active storage are successively migrated to respective evacuated active/inactive disk drives so that each active/inactive disk drive is loaded with files having a similar probability of access when access to the active/inactive disk drive reaches an inactivity threshold for powering down the active/inactive disk drive. Storage of the active/inactive disk drives is reclaimed when an oldest group of the files is archived or when an active/inactive disk drive is evacuated by migrating files from the active/inactive disk drive to storage having been released in other disk drives by promotion of files for client access to the promoted files. Therefore, recovery of storage can be planned and scheduled in advance and performed efficiently in a background process.

Abstract translation: 文件服务器包括包含经常访问的文件的活动存储器，以及用于包含不经常访问的文件的主动/非活动磁盘驱动器。 在活动存储器中变得不活动的文件组被依次迁移到相应的撤离的活动/非活动磁盘驱动器，使得当访问活动/非活动磁盘驱动器到达时，每个活动/非活动磁盘驱动器被加载具有相似的访问概率的文件 用于关闭主动/非活动磁盘驱动器的非活动阈值。 当归档最旧的文件组或通过将活动/非活动磁盘驱动器中的文件迁移到已经通过宣传释放到其他磁盘驱动器中的存储而将主动/不活动磁盘驱动器撤离时，将回收活动/非活动磁盘驱动器的存储 的文件，以便客户端访问升级的文件。 因此，可以预先规划和调度存储的恢复并且在后台进程中有效地执行。

公开(公告)号：US09087075B1

公开(公告)日：2015-07-21

申请号：US13536331

申请日：2012-06-28

Applicant: Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Zhenhua Zhang ,  Gary Grider

Inventor： Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Zhenhua Zhang ,  Gary Grider

IPC: G06F17/30

CPC classification number: G06F17/30212

Abstract: Improved techniques are provided for storing files in a parallel computing system using a list-based index to identify file replicas. A file and at least one replica of the file are stored in one or more storage nodes of the parallel computing system. An index for the file comprises at least one list comprising a pointer to a storage location of the file and a storage location of the at least one replica of the file. The file comprises one or more of a complete file and one or more sub-files. The index may also comprise a checksum value for one or more of the file and the replica(s) of the file. The checksum value can be evaluated to validate the file and/or the file replica(s). A query can be processed using the list.

Abstract translation: 提供了改进的技术，用于使用基于列表的索引来在并行计算系统中存储文件以识别文件副本。 文件和文件的至少一个副本存储在并行计算系统的一个或多个存储节点中。 文件的索引包括至少一个列表，其包括指向文件的存储位置的指针和该文件的至少一个副本的存储位置。 该文件包括完整文件和一个或多个子文件中的一个或多个。 索引还可以包括文件中的一个或多个文件和文件副本的校验和值。 可以评估校验和值以验证文件和/或文件副本。 可以使用列表处理查询。

公开(公告)号：US08719590B1

公开(公告)日：2014-05-06

申请号：US13525919

申请日：2012-06-18

Applicant: Sorin Faibish ,  Percy Tzelnic

Inventor： Sorin Faibish ,  Percy Tzelnic

IPC: G06F12/14

CPC classification number: H04L63/0428 ,  G06F21/10 ,  G06F21/602 ,  G06F2221/0748 ,  H04L9/085 ,  H04L9/0894 ,  H04L12/4641 ,  H04L67/10

Abstract: Cloud infrastructure of an information processing system comprises one or more processing devices implementing a plurality of virtual machines. The cloud infrastructure is configured to receive a processing job from a tenant, to obtain a first key specific to the tenant, to determine a second key utilizing information supplied by the tenant, and to encrypt one or more results of the processing job utilizing a combination of the first key and the second key. At least a portion of the second key is determined by at least one application that is run on at least one virtual machine of the cloud infrastructure in conjunction with performance of the processing job. The encrypted results of the processing job may be stored in a virtual memory of the cloud infrastructure and transmitted to the tenant.

Abstract translation: 信息处理系统的云基础设施包括实现多个虚拟机的一个或多个处理设备。 云基础架构被配置为从租户接收处理作业，以获得租户特有的第一密钥，以利用租户提供的信息来确定第二密钥，并且利用组合来加密处理作业的一个或多个结果 的第一个键和第二个键。 结合执行处理作业，由至少一个在云基础设施的一个虚拟机上运行的应用程序确定第二个密钥的至少一部分。 处理作业的加密结果可以存储在云基础设施的虚拟存储器中并被传送给租户。

公开(公告)号：US09165014B1

公开(公告)日：2015-10-20

申请号：US13536358

申请日：2012-06-28

Applicant: Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Aaron Torres

Inventor： Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Aaron Torres

IPC: G06F17/30

CPC classification number: G06F17/30215 ,  G06F17/30244

Abstract: Techniques are provided for storing files in a parallel computing system using different resolutions. A method is provided for storing at least one file generated by a distributed application in a parallel computing system. The file comprises one or more of a complete file and a sub-file. The method comprises the steps of obtaining semantic information related to the file; generating a plurality of replicas of the file with different resolutions based on the semantic information; and storing the file and the plurality of replicas of the file in one or more storage nodes of the parallel computing system. The different resolutions comprise, for example, a variable number of bits and/or a different sub-set of data elements from the file. A plurality of the sub-files can be merged to reproduce the file.

Abstract translation: 提供了使用不同分辨率在并行计算系统中存储文件的技术。 提供了一种用于将由分布式应用生成的至少一个文件存储在并行计算系统中的方法。 该文件包括完整文件和子文件中的一个或多个。 该方法包括获取与文件相关的语义信息的步骤; 基于语义信息生成具有不同分辨率的文件的多个副本; 以及将所述文件的文件和所述多个副本存储在所述并行计算系统的一个或多个存储节点中。 不同的分辨率例如包括来自文件的可变数量的位和/或不同的数据元素子集。 可以合并多个子文件以再现该文件。

公开(公告)号：US08868576B1

公开(公告)日：2014-10-21

申请号：US13536369

申请日：2012-06-28

Applicant: Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Adam Manzanares ,  Aaron Torres

Inventor： Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Adam Manzanares ,  Aaron Torres

IPC: G06F17/30

CPC classification number: G06F17/3056 ,  G06F17/30091

Abstract: Techniques are provided for storing files in a parallel computing system based on a user-specified parser function. A plurality of files generated by a distributed application in a parallel computing system are stored by obtaining a parser from the distributed application for processing the plurality of files prior to storage; and storing one or more of the plurality of files in one or more storage nodes of the parallel computing system based on the processing by the parser. The plurality of files comprise one or more of a plurality of complete files and a plurality of sub-files. The parser can optionally store only those files that satisfy one or more semantic requirements of the parser. The parser can also extract metadata from one or more of the files and the extracted metadata can be stored with one or more of the plurality of files and used for searching for files.

Abstract translation: 提供了用于基于用户指定的解析器功能在并行计算系统中存储文件的技术。 由并行计算系统中的分布式应用程序生成的多个文件通过从分布式应用程序获得解析器来存储，用于在存储之前处理多个文件; 以及基于所述解析器的处理，将所述多个文件中的一个或多个存储在所述并行计算系统的一个或多个存储节点中。 多个文件包括多个完整文件和多个子文件中的一个或多个。 解析器可以可选地仅存储满足解析器的一个或多个语义要求的那些文件。 解析器还可以从一个或多个文件中提取元数据，并且所提取的元数据可以与多个文件中的一个或多个文件一起存储并用于搜索文件。

公开(公告)号：US08825652B1

公开(公告)日：2014-09-02

申请号：US13536315

申请日：2012-06-28

Applicant: Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Jingwang Zhang

Inventor： Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Jingwang Zhang

IPC: G06F17/30

CPC classification number: G06F17/302

Abstract: Techniques are provided for small file aggregation in a parallel computing system. An exemplary method for storing a plurality of files generated by a plurality of processes in a parallel computing system comprises aggregating the plurality of files into a single aggregated file; and generating metadata for the single aggregated file. The metadata comprises an offset and a length of each of the plurality of files in the single aggregated file. The metadata can be used to unpack one or more of the files from the single aggregated file.

Abstract translation: 在并行计算系统中提供了用于小文件聚合的技术。 用于存储由并行计算系统中的多个进程生成的多个文件的示例性方法包括将所述多个文件聚合成单个聚合文件; 并为单个聚合文件生成元数据。 元数据包括单个聚合文件中的多个文件中的每一个的偏移量和长度。 元数据可用于从单个聚合文件中解压缩一个或多个文件。

公开(公告)号：US08949255B1

公开(公告)日：2015-02-03

申请号：US13536384

申请日：2012-06-28

Applicant: Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Aaron Torres

Inventor： Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Aaron Torres

IPC: G06F17/30

CPC classification number: G06F17/301

Abstract: Techniques are provided for storing files in a parallel computing system using sub-files with semantically meaningful boundaries. A method is provided for storing at least one file generated by a distributed application in a parallel computing system. The file comprises one or more of a complete file and a plurality of sub-files. The method comprises the steps of obtaining a user specification of semantic information related to the file; providing the semantic information as a data structure description to a data formatting library write function; and storing the semantic information related to the file with one or more of the sub-files in one or more storage nodes of the parallel computing system. The semantic information provides a description of data in the file. The sub-files can be replicated based on semantically meaningful boundaries.

Abstract translation: 提供了使用具有语义有意义的边界的子文件在并行计算系统中存储文件的技术。 提供了一种用于将由分布式应用生成的至少一个文件存储在并行计算系统中的方法。 该文件包括完整文件和多个子文件中的一个或多个。 该方法包括以下步骤：获得与文件相关的语义信息的用户指定; 提供语义信息作为数据格式化库写入功能的数据结构描述; 以及将与所述文件相关的所述语义信息与所述子文件中的一个或多个存储在所述并行计算系统的一个或多个存储节点中。 语义信息提供文件中数据的描述。 子文件可以基于语义有意义的边界进行复制。

公开(公告)号：US09213721B1

公开(公告)日：2015-12-15

申请号：US12348866

申请日：2009-01-05

Applicant: Sorin Faibish ,  Christopher H. Stacey ,  Peter Bixby ,  William C. Whitney

Inventor： Sorin Faibish ,  Christopher H. Stacey ,  Peter Bixby ,  William C. Whitney

IPC: G06F7/00 ,  G06F17/30

CPC classification number: G06F17/30221

Abstract: A file server system having solid-state drive primary storage and magnetic disk drive secondary storage aggressively moves newly created files from the primary storage to selected file systems in the secondary storage to match expected access patterns upon the files to different configurations of the file systems and for load balancing upon the file systems in the secondary storage. Upon read access to a file that has been moved to the secondary storage, or upon migration of a newly created file that was read in primary storage after creation, a corresponding stub file containing file mapping metadata is created in the primary storage. The file mapping metadata in the stub file maps the extent of the file to logical storage addresses in the secondary storage.

Abstract translation: 具有固态驱动器主存储器和磁盘驱动器辅助存储器的文件服务器系统将新创建的文件从主存储器大量移动到辅助存储器中的选定文件系统，以将文件上的预期访问模式与文件系统的不同配置相匹配， 用于在二级存储器中的文件系统上进行负载平衡。 在读取访问已被移动到辅助存储器的文件之后，或者在创建之后迁移新创建的在主存储器中读取的文件时，将在主存储器中创建包含文件映射元数据的对应存根文件。 存根文件中的文件映射元数据将文件的范围映射到辅助存储中的逻辑存储地址。

公开(公告)号：US09110695B1

公开(公告)日：2015-08-18

申请号：US13730112

申请日：2012-12-28

Applicant: John M. Bent ,  Sorin Faibish

Inventor： John M. Bent ,  Sorin Faibish

IPC: G06F9/455

CPC classification number: G06F9/45533 ,  G06F9/45558 ,  G06F2009/45579

Abstract: Interactive requests are processed from users of log-in nodes. A metadata server node is provided for use in a file system shared by one or more interactive nodes and one or more batch nodes. The interactive nodes comprise interactive clients to execute interactive tasks and the batch nodes execute batch jobs for one or more batch clients. The metadata server node comprises a virtual machine monitor; an interactive client proxy to store metadata requests from the interactive clients in an interactive client queue; a batch client proxy to store metadata requests from the batch clients in a batch client queue; and a metadata server to store the metadata requests from the interactive client queue and the batch client queue in a metadata queue based on an allocation of resources by the virtual machine monitor. The metadata requests can be prioritized, for example, based on one or more of a predefined policy and predefined rules.

Abstract translation: 从登录节点的用户处理交互式请求。 提供元数据服务器节点用于由一个或多个交互式节点和一个或多个批处理节点共享的文件系统。 交互式节点包括交互式客户端以执行交互式任务，批处理节点为一个或多个批处理客户端执行批处理作业。 元数据服务器节点包括虚拟机监视器; 交互式客户端代理，用于在交互式客户端队列中存储来自交互式客户机的元数据请求; 批处理客户机代理，用于在批处理客户端队列中存储批处理客户端的元数据请求; 以及元数据服务器，用于基于虚拟机监视器的资源分配来存储元数据队列中来自交互式客户机队列和批处理客户机队列的元数据请求。 元数据请求可以被优先化，例如，基于预定义策略和预定义规则中的一个或多个。

公开(公告)号：US08429307B1

公开(公告)日：2013-04-23

申请号：US12826749

申请日：2010-06-30

Applicant: Sorin Faibish ,  Philippe Armangau ,  Christopher Seibel

Inventor： Sorin Faibish ,  Philippe Armangau ,  Christopher Seibel

IPC: G06F3/00

CPC classification number: G06F3/0605 ,  G06F3/0631 ,  G06F3/0653 ,  G06F3/0685 ,  G06F3/0689

Abstract: This invention is a system and a method for operating a storage server that provides read or write access to a data in a data network using a new architecture. The method of processing I/Os in response to a request by a client of the storage server executes one or more services communicated by a policy engine. The I/Os received from the application are tagged and catalogued to create co-related I/O patterns. The policy engine is then updated with the results of processing the I/Os after executing services on those I/Os.

Abstract translation: 本发明是一种用于操作存储服务器的系统和方法，该存储服务器使用新架构提供对数据网络中的数据的读取或写入访问。 响应于存储服务器的客户端的请求来处理I / O的方法执行由策略引擎传送的一个或多个服务。 从应用程序接收的I / O被标记和编目，以创建共同相关的I / O模式。 然后在执行这些I / O上的服务之后，更新处理I / O的结果的策略引擎。