公开(公告)号：US08006111B1

公开(公告)日：2011-08-23

申请号：US11859100

申请日：2007-09-21

申请人： Sorin Faibish ,  Peter Bixby ,  Percy Tzelnic

发明人： Sorin Faibish ,  Peter Bixby ,  Percy Tzelnic

IPC分类号： G06F1/32

CPC分类号： G06F3/0625 ,  G06F1/3221 ,  G06F1/3268 ,  G06F1/3287 ,  G06F3/0649 ,  G06F3/067 ,  G06F17/30147 ,  Y02D10/154 ,  Y02D10/171

摘要： A file server includes active storage containing frequently accessed files, and active/inactive disk drives for containing infrequently accessed files. Groups of the files having become inactive in the active storage are successively migrated to respective evacuated active/inactive disk drives so that each active/inactive disk drive is loaded with files having a similar probability of access when access to the active/inactive disk drive reaches an inactivity threshold for powering down the active/inactive disk drive. Storage of the active/inactive disk drives is reclaimed when an oldest group of the files is archived or when an active/inactive disk drive is evacuated by migrating files from the active/inactive disk drive to storage having been released in other disk drives by promotion of files for client access to the promoted files. Therefore, recovery of storage can be planned and scheduled in advance and performed efficiently in a background process.

摘要翻译： 文件服务器包括包含经常访问的文件的活动存储器，以及用于包含不经常访问的文件的主动/非活动磁盘驱动器。 在活动存储器中变得不活动的文件组被依次迁移到相应的撤离的活动/非活动磁盘驱动器，使得当访问活动/非活动磁盘驱动器到达时，每个活动/非活动磁盘驱动器被加载具有相似的访问概率的文件 用于关闭主动/非活动磁盘驱动器的非活动阈值。 当归档最旧的文件组或通过将活动/非活动磁盘驱动器中的文件迁移到已经通过宣传释放到其他磁盘驱动器中的存储而将主动/不活动磁盘驱动器撤离时，将回收活动/非活动磁盘驱动器的存储 的文件，以便客户端访问升级的文件。 因此，可以预先规划和调度存储的恢复并且在后台进程中有效地执行。

公开(公告)号：US5893140A

公开(公告)日：1999-04-06

申请号：US747631

申请日：1996-11-13

申请人： Uresh K Vahalia ,  Uday Gupta ,  Betti Porat ,  Percy Tzelnic

发明人： Uresh K Vahalia ,  Uday Gupta ,  Betti Porat ,  Percy Tzelnic

IPC分类号： G06F11/14 ,  G06F12/08 ,  G06F17/30 ,  H04L29/08 ,  G06F12/00

CPC分类号： G06F17/30171 ,  G06F11/1435 ,  G06F12/0804 ,  G06F12/0813 ,  G06F12/0866 ,  H04L67/1095 ,  Y10S706/908

摘要： A conventional network file server has a file system that permits file attributes and file data to be written in any order. The conventional network file server may also support an asynchronous write protocol, in which file attributes and file data need not be written to disk storage until a client sends a commit request. This asynchronous write protocol has a data security problem if the attributes are written before the data and the server crashes before completing the writing of the data to disk storage. This security problem is solved by adding a file system cache and following a protocol that writes the attributes to storage after writing the data to storage. For example, the attributes and data are stored in the file system cache and are not written down to storage until receipt of a commit request. When the commit request is received, the data is sent first from the file system cache to storage. Then the attributes are sent from the file system cache to storage. Then the file server acknowledges completion of the commit operation. In a preferred embodiment, storage is provided by an integrated cached disk array (ICDA) having a buffer cache and an array of disk drives, and the file system cache is distributed in a plurality of data mover computers interfaced to the ICDA. The addition of the file system cache to solve the security problem also reduces the burden on the buffer cache in the ICDA.

摘要翻译： 传统的网络文件服务器具有允许以任何顺序写入文件属性和文件数据的文件系统。 传统的网络文件服务器还可以支持异步写入协议，其中文件属性和文件数据不需要写入磁盘存储器，直到客户端发送提交请求。 如果在完成将数据写入磁盘存储器之前，数据之前写入的属性和服务器崩溃，则此异步写入协议有数据安全问题。 通过添加文件系统缓存并在将数据写入存储后遵循将属性写入存储的协议来解决此安全问题。 例如，属性和数据存储在文件系统缓存中，并且不会被写入存储，直到收到提交请求。 收到提交请求后，首先将数据从文件系统缓存发送到存储。 然后将属性从文件系统缓存发送到存储。 然后文件服务器确认完成提交操作。 在优选实施例中，通过具有缓冲高速缓存和磁盘驱动器阵列的集成缓存磁盘阵列（ICDA）提供存储，并且文件系统高速缓存分布在与ICDA接口的多个数据移动器计算机中。 加上文件系统缓存来解决安全问题，也减轻了ICDA缓冲区高速缓存的负担。

公开(公告)号：US5528513A

公开(公告)日：1996-06-18

申请号：US148114

申请日：1993-11-04

申请人： Lev Vaitzblit ,  Kadangode K. Ramakrishnan ,  Percy Tzelnic

发明人： Lev Vaitzblit ,  Kadangode K. Ramakrishnan ,  Percy Tzelnic

IPC分类号： H04L29/06 ,  H04L29/08 ,  H04N7/173 ,  G06F15/20

CPC分类号： H04L65/80 ,  H04L29/06027 ,  H04L67/322 ,  H04L67/325 ,  H04L69/329 ,  H04N7/17336

摘要： A scheduler with admissions control in a continuous media file server is presented. The scheduler supports multiple classes of tasks with diverse performance requirements. The scheduler is based on a combination of rate-monotonic and weighted round-robin scheduling schemes. Scheduling is accomplished in a hierarchical manner. Isochronous tasks have the highest priority and are scheduled first followed by real-time and general-purpose tasks. Isochronous tasks run periodically and are invoked by a timer interrupt set for each task. After scheduling the isochronous tasks, the scheduler alternates between the real-time tasks and the general-purpose tasks using a weighted round-robin scheme.

摘要翻译： 介绍了一种在连续媒体文件服务器中具有入口控制的调度器。 调度程序支持具有不同性能要求的多类任务。 调度器基于速率单调和加权循环调度方案的组合。 调度以分级方式完成。 同步任务具有最高优先级，并且首先安排，之后是实时和通用任务。 同步任务周期性运行，并由每个任务的定时器中断集调用。 在调度同步任务之后，调度器使用加权循环方案在实时任务和通用任务之间交替。

公开(公告)号：US09165014B1

公开(公告)日：2015-10-20

申请号：US13536358

申请日：2012-06-28

申请人： Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Aaron Torres

发明人： Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Gary Grider ,  Aaron Torres

IPC分类号： G06F17/30

CPC分类号： G06F17/30215 ,  G06F17/30244

摘要： Techniques are provided for storing files in a parallel computing system using different resolutions. A method is provided for storing at least one file generated by a distributed application in a parallel computing system. The file comprises one or more of a complete file and a sub-file. The method comprises the steps of obtaining semantic information related to the file; generating a plurality of replicas of the file with different resolutions based on the semantic information; and storing the file and the plurality of replicas of the file in one or more storage nodes of the parallel computing system. The different resolutions comprise, for example, a variable number of bits and/or a different sub-set of data elements from the file. A plurality of the sub-files can be merged to reproduce the file.

摘要翻译： 提供了使用不同分辨率在并行计算系统中存储文件的技术。 提供了一种用于将由分布式应用生成的至少一个文件存储在并行计算系统中的方法。 该文件包括完整文件和子文件中的一个或多个。 该方法包括获取与文件相关的语义信息的步骤; 基于语义信息生成具有不同分辨率的文件的多个副本; 以及将所述文件的文件和所述多个副本存储在所述并行计算系统的一个或多个存储节点中。 不同的分辨率例如包括来自文件的可变数量的位和/或不同的数据元素子集。 可以合并多个子文件以再现该文件。

公开(公告)号：US07739379B1

公开(公告)日：2010-06-15

申请号：US10871600

申请日：2004-06-18

申请人： Uresh K. Vahalia ,  Uday Gupta ,  Betti Porat ,  Percy Tzelnic

发明人： Uresh K. Vahalia ,  Uday Gupta ,  Betti Porat ,  Percy Tzelnic

IPC分类号： G06F15/16 ,  G06F15/167 ,  G06F15/173

CPC分类号： G06F17/30171

摘要： A network file server includes a first set of data processors for receiving requests from clients, and a second set of data processors for accessing read-write file systems. A respective data processor in the second set is assigned to each file system for exclusive management of read and write locks on the file system. Each data processor in the first set can authorize access to file systems directly accessed by more than one data processor in the second set. Processing of a request for access that is authorized is continued by the data processor that is assigned to manage the locks on the file system to be accessed. The exclusivity of lock management eliminates cache coherency problems, and dynamic load balancing can be used to prevent the lock management from becoming a bottleneck to performance. A preferred embodiment includes a cached disk storage subsystem linked to data mover computers. Each data mover has authorization and ownership information for a plurality of file systems, and maintains a local cache of locking information for file systems that the data mover can directly access. The data mover receives a client request, and if access is authorized, checks whether it can directly access the file, and if not, forwards the request to another data mover.

摘要翻译： 网络文件服务器包括用于接收来自客户端的请求的第一组数据处理器和用于访问读写文件系统的第二组数据处理器。 第二组中的相应数据处理器被分配给每个文件系统，用于对文件系统上的读取和写入锁定进行排他性管理。 第一组中的每个数据处理器可以授权访问由第二组中的多个数据处理器直接访问的文件系统。 被授权的访问请求的处理由被分配用于管理要访问的文件系统上的锁的数据处理器继续。 锁管理的排他性消除了缓存一致性问题，动态负载平衡可以用来防止锁管理成为性能的瓶颈。 优选实施例包括链接到数据移动器计算机的高速缓存的磁盘存储子系统。 每个数据移动器具有用于多个文件系统的授权和所有权信息，并维护数据移动者可以直接访问的文件系统的锁定信息的本地缓存。 数据移动器接收客户端请求，如果访问被授权，则检查它是否可以直接访问该文件，如果不是，则将该请求转发给另一个数据移动器。

公开(公告)号：US06324581B1

公开(公告)日：2001-11-27

申请号：US09261542

申请日：1999-03-03

申请人： Yikang Xu ,  Uresh K. Vahalia ,  Xiaoye Jiang ,  Uday Gupta ,  Percy Tzelnic

发明人： Yikang Xu ,  Uresh K. Vahalia ,  Xiaoye Jiang ,  Uday Gupta ,  Percy Tzelnic

IPC分类号： G06F1516

CPC分类号： H04L67/2819 ,  G06F17/30171 ,  H04L29/06 ,  H04L67/42 ,  H04L69/329

摘要： A plurality of data mover computers control access to respective file systems in data storage. A network client serviced by any of the data movers can access each of the file systems. If a data mover receives a client request for access to a file in a file system to which access is controlled by another data mover, then the data mover that received the client request sends a metadata request to the data mover that controls access to the file system. The data mover that controls access to the file system responds by placing a lock on the file and returning metadata of the file. The data mover that received the client request uses the metadata to formulate a data access command that is used to access the file data in the file system over a bypass data path that bypasses the data mover computer that controls access to the file system.

摘要翻译： 多个数据移动器计算机控制对数据存储中的相应文件系统的访问。 由任何数据移动器服务的网络客户机可以访问每个文件系统。 如果数据移动者接收到访问由另一个数据移动器控制访问的文件系统中的文件的客户端请求，则接收到客户端请求的数据移动器向控制对该文件的访问的数据移动器发送元数据请求 系统。 控制对文件系统访问的数据移动器通过对文件进行锁定并返回文件的元数据来做出响应。 接收客户端请求的数据移动器使用元数据来制定数据访问命令，该命令用于通过旁路数据路径访问文件系统中的文件数据，旁路数据路径绕过控制对文件系统的访问的数据移动器计算机。

公开(公告)号：US06192408B1

公开(公告)日：2001-02-20

申请号：US08938723

申请日：1997-09-26

申请人： Uresh K. Vahalia ,  Uday Gupta ,  Betti Porat ,  Percy Tzelnic

发明人： Uresh K. Vahalia ,  Uday Gupta ,  Betti Porat ,  Percy Tzelnic

IPC分类号： G06F1516

CPC分类号： G06F17/30171

摘要： A network file server includes a first set of data processors for receiving requests from clients, and a second set of data processors for accessing read-write file systems. A respective data processor in the second set is assigned to each file system for exclusive management of read and write locks on the file system. Each data processor in the first set can authorize access to file systems directly accessed by more than one data processor in the second set. Processing of a request for access that is authorized is continued by the data processor that is assigned to manage the locks on the file system to be accessed. The exclusivity of lock management eliminates cache coherency problems, and dynamic load balancing can be used to prevent the lock management from becoming a bottleneck to performance. A preferred embodiment includes a cached disk storage subsystem linked to data mover computers. Each data mover has authorization and ownership information for a plurality of file systems, and maintains a local cache of locking information for file systems that the data mover can directly access. The data mover receives a client request, and if access is authorized, checks whether it can directly access the file, and if not, forwards the request to another data mover.

摘要翻译： 网络文件服务器包括用于接收来自客户端的请求的第一组数据处理器和用于访问读写文件系统的第二组数据处理器。 第二组中的相应数据处理器被分配给每个文件系统，用于对文件系统上的读取和写入锁定进行排他性管理。 第一组中的每个数据处理器可以授权访问由第二组中的多个数据处理器直接访问的文件系统。 被授权的访问请求的处理由被分配用于管理要访问的文件系统上的锁的数据处理器继续。 锁管理的排他性消除了缓存一致性问题，动态负载平衡可以用来防止锁管理成为性能的瓶颈。 优选实施例包括链接到数据移动器计算机的高速缓存的磁盘存储子系统。 每个数据移动器具有用于多个文件系统的授权和所有权信息，并维护数据移动者可以直接访问的文件系统的锁定信息的本地缓存。 数据移动器接收客户端请求，如果访问被授权，则检查它是否可以直接访问该文件，如果不是，则将该请求转发给另一个数据移动器。

公开(公告)号：US5944789A

公开(公告)日：1999-08-31

申请号：US748363

申请日：1996-11-13

申请人： Percy Tzelnic ,  Uresh K Vahalia

发明人： Percy Tzelnic ,  Uresh K Vahalia

IPC分类号： G06F12/08 ,  G06F17/30 ,  H04L29/08 ,  G06F15/163

CPC分类号： G06F17/30171 ,  G06F12/0813 ,  G06F12/0815 ,  H04L67/1095 ,  G06F12/0866 ,  G06F2212/312 ,  Y10S707/99937 ,  Y10S707/99938

摘要： A network file server includes an integrated cached disk array and a plurality of data mover computers linking the cached disk array to the data network for file access. Each data mover computer maintains a local cache of file directory information including locking information of locked files that are accessible through the data mover. A cache consistency scheme ensures that shared locking information is consistent in the local caches. In a preferred embodiment, the cache consistency scheme uses an internal data link to pass messages between the data movers. The file directory information in the local cache includes information mapping file names to a list of logical blocks for each file name, file attributes that affect data access, and locking information down to a block level of granularity. Each data mover computer has network file manager software that maintains client ownership of locked files and communicates with the clients, and data mover file manager software that manages data mover computer ownership of locked files and communicates with other data mover computers. The cache consistency messages indicate a grant of data mover ownership over a file, a release of data mover ownership over a file, a denial of a request for access to a locked file, and changes to file attributes affecting access to a file. The local caches and the cache consistency scheme eliminate any need to store file locking information in the cached disk array.

摘要翻译： 网络文件服务器包括集成的缓存磁盘阵列和将高速缓存的磁盘阵列链接到数据网络以进行文件访问的多个数据移动器计算机。 每个数据移动器计算机维护文件目录信息的本地缓存，包括可通过数据移动器访问的锁定文件的锁定信息。 缓存一致性方案确保共享锁定信息在本地缓存中是一致的。 在优选实施例中，高速缓存一致性方案使用内部数据链路来在数据移动器之间传递消息。 本地缓存中的文件目录信息包括将文件名称映射到每个文件名的逻辑块列表，影响数据访问的文件属性以及将信息锁定到块级别的信息。 每个数据移动器计算机具有网络文件管理器软件，其维护客户端对锁定文件的所有权并与客户端通信，以及数据移动器文件管理器软件，其管理数据移动器计算机对锁定文件的所有权并与其他数据移动器计算机通信。 高速缓存一致性消息表示数据移动器对文件的所有权的授予，文件上的数据移动器所有权的释放，对访问被锁定的文件的拒绝请求以及影响访问文件的文件属性的改变。 本地缓存和缓存一致性方案消除了将文件锁定信息存储在缓存磁盘阵列中的任何需要。

公开(公告)号：US5829046A

公开(公告)日：1998-10-27

申请号：US661187

申请日：1996-06-10

申请人： Percy Tzelnic ,  Scott R. Dunham

发明人： Percy Tzelnic ,  Scott R. Dunham

IPC分类号： G06F11/14 ,  G06F12/08 ,  H04L29/06 ,  H04L29/08 ,  H04N7/173 ,  H04N21/218 ,  H04N21/239 ,  G06F12/14

CPC分类号： H04L67/1095 ,  G06F11/1456 ,  G06F11/1461 ,  G06F11/1469 ,  G06F12/0866 ,  H04L65/4084 ,  H04L65/602 ,  H04L67/42 ,  H04N21/2182 ,  H04N21/2396 ,  H04N7/17318 ,  G06F11/2035 ,  G06F2212/312 ,  H04L29/06027

摘要： A video file server includes an integrated cached disk array storage subsystem and a plurality of stream server computers linking the cached disk array to a data network for the transfer of video data streams. The video file server further includes a controller server for applying an admission control policy to client requests and assigning stream servers to service the client requests. The stream servers include a real-time scheduler for scheduling isochronous tasks, and supports at least one industry standard network file access protocol and one file access protocol for continuous media file access. The cached disk storage subsystem is responsive to video prefetch commands, and the data specified for a prefetch command for a process are retained in an allocated portion of the cache memory from the time that the cached disk storage subsystem has responded to the prefetch command to the time that the cached disk storage subsystem responds to a fetch command specifying the data for the process. The time between prefetching and fetching is selected based on available disk and cache resources. The video file server provides video-on-demand service by maintaining and dynamically allocating sliding windows of video data in the random access memories of the stream server computers. The video file server has a tape silo for providing network backup services, and data to be written to tape are prestaged in the cached disk storage subsystem.

摘要翻译： 视频文件服务器包括集成缓存的磁盘阵列存储子系统和将高速缓存的磁盘阵列链接到用于传输视频数据流的数据网络的多个流服务器计算机。 该视频文件服务器还包括控制器服务器，用于向客户端请求应用准入控制策略，并分配流服务器来服务客户机请求。 流服务器包括用于调度等时任务的实时调度器，并且支持至少一个工业标准网络文件访问协议和用于连续媒体文件访问的一个文件访问协议。 缓存的磁盘存储子系统响应于视频预取命令，并且对于进程的预取命令指定的数据从缓存的磁盘存储子系统对预取命令作出响应的时间保留在高速缓冲存储器的分配部分中 缓存磁盘存储子系统响应指定进程数据的fetch命令的时间。 基于可用的磁盘和缓存资源选择预取和提取之间的时间。 视频文件服务器通过维护和动态地分配流服务器计算机的随机存取存储器中的视频数据的滑动窗口来提供视频点播服务。 视频文件服务器具有用于提供网络备份服务的磁带仓，要写入磁带的数据预存在缓存的磁盘存储子系统中。

公开(公告)号：US09087075B1

公开(公告)日：2015-07-21

申请号：US13536331

申请日：2012-06-28

申请人： Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Zhenhua Zhang ,  Gary Grider

发明人： Sorin Faibish ,  John M. Bent ,  Percy Tzelnic ,  Zhenhua Zhang ,  Gary Grider

IPC分类号： G06F17/30

CPC分类号： G06F17/30212

摘要： Improved techniques are provided for storing files in a parallel computing system using a list-based index to identify file replicas. A file and at least one replica of the file are stored in one or more storage nodes of the parallel computing system. An index for the file comprises at least one list comprising a pointer to a storage location of the file and a storage location of the at least one replica of the file. The file comprises one or more of a complete file and one or more sub-files. The index may also comprise a checksum value for one or more of the file and the replica(s) of the file. The checksum value can be evaluated to validate the file and/or the file replica(s). A query can be processed using the list.

摘要翻译： 提供了改进的技术，用于使用基于列表的索引来在并行计算系统中存储文件以识别文件副本。 文件和文件的至少一个副本存储在并行计算系统的一个或多个存储节点中。 文件的索引包括至少一个列表，其包括指向文件的存储位置的指针和该文件的至少一个副本的存储位置。 该文件包括完整文件和一个或多个子文件中的一个或多个。 索引还可以包括文件中的一个或多个文件和文件副本的校验和值。 可以评估校验和值以验证文件和/或文件副本。 可以使用列表处理查询。