File server having a file system cache and protocol for truly safe
asynchronous writes
    1.
    发明授权
    File server having a file system cache and protocol for truly safe asynchronous writes 失效
    文件服务器具有用于真正安全的异步写入的文件系统缓存和协议

    公开(公告)号:US5893140A

    公开(公告)日:1999-04-06

    申请号:US747631

    申请日:1996-11-13

    摘要: A conventional network file server has a file system that permits file attributes and file data to be written in any order. The conventional network file server may also support an asynchronous write protocol, in which file attributes and file data need not be written to disk storage until a client sends a commit request. This asynchronous write protocol has a data security problem if the attributes are written before the data and the server crashes before completing the writing of the data to disk storage. This security problem is solved by adding a file system cache and following a protocol that writes the attributes to storage after writing the data to storage. For example, the attributes and data are stored in the file system cache and are not written down to storage until receipt of a commit request. When the commit request is received, the data is sent first from the file system cache to storage. Then the attributes are sent from the file system cache to storage. Then the file server acknowledges completion of the commit operation. In a preferred embodiment, storage is provided by an integrated cached disk array (ICDA) having a buffer cache and an array of disk drives, and the file system cache is distributed in a plurality of data mover computers interfaced to the ICDA. The addition of the file system cache to solve the security problem also reduces the burden on the buffer cache in the ICDA.

    摘要翻译: 传统的网络文件服务器具有允许以任何顺序写入文件属性和文件数据的文件系统。 传统的网络文件服务器还可以支持异步写入协议,其中文件属性和文件数据不需要写入磁盘存储器,直到客户端发送提交请求。 如果在完成将数据写入磁盘存储器之前,数据之前写入的属性和服务器崩溃,则此异步写入协议有数据安全问题。 通过添加文件系统缓存并在将数据写入存储后遵循将属性写入存储的协议来解决此安全问题。 例如,属性和数据存储在文件系统缓存中,并且不会被写入存储,直到收到提交请求。 收到提交请求后,首先将数据从文件系统缓存发送到存储。 然后将属性从文件系统缓存发送到存储。 然后文件服务器确认完成提交操作。 在优选实施例中,通过具有缓冲高速缓存和磁盘驱动器阵列的集成缓存磁盘阵列(ICDA)提供存储,并且文件系统高速缓存分布在与ICDA接口的多个数据移动器计算机中。 加上文件系统缓存来解决安全问题,也减轻了ICDA缓冲区高速缓存的负担。

    File server system providing direct data sharing between clients with a server acting as an arbiter and coordinator
    2.
    发明授权
    File server system providing direct data sharing between clients with a server acting as an arbiter and coordinator 有权
    文件服务器系统提供客户端与作为仲裁器和协调器的服务器之间的直接数据共享

    公开(公告)号:US07437407B2

    公开(公告)日:2008-10-14

    申请号:US11168058

    申请日:2005-06-27

    IPC分类号: G06F15/16

    摘要: A client is permitted to send data access commands directly to network data storage of a network file server after obtaining a lock on at least a portion of the file and obtaining metadata indicating storage locations for the data in the data storage. For example, the client sends to the file server at least one request for access to a file. In response, the file server grants a lock to the client, and returns to the client metadata of the file including information specifying data storage locations in the network data storage for storing data of the file. The client receives the metadata, and uses the metadata to produce at least one data access command for accessing the data storage locations in the network storage. The client sends the data access command to the network data storage to read or write data to the file. For a write operation, the client may modify the metadata. When the client is finished writing to the file, the client returns any modified metadata to the file server.

    摘要翻译: 允许客户端在获取对文件的至少一部分的锁定并且获得指示数据存储器中的数据的存储位置的元数据之后,将数据访问命令直接发送到网络文件服务器的网络数据存储器。 例如,客户端向文件服务器发送至少一个访问文件的请求。 作为响应,文件服务器向客户端授予锁定,并且返回到文件的客户端元数据,包括指定用于存储文件的数据的网络数据存储器中的数据存储位置的信息。 客户端接收元数据,并使用元数据产生用于访问网络存储器中的数据存储位置的至少一个数据访问命令。 客户端将数据访问命令发送到网络数据存储器,以将数据读取或写入文件。 对于写操作,客户端可以修改元数据。 当客户端完成写入文件时,客户端将任何修改的元数据返回给文件服务器。

    File server system providing direct data sharing between clients with a server acting as an arbiter and coordinator

    公开(公告)号:US06973455B1

    公开(公告)日:2005-12-06

    申请号:US09261621

    申请日:1999-03-03

    IPC分类号: G06F7/00 G06F17/30

    摘要: A client is permitted to send data access commands directly to network data storage of a network file server after obtaining a lock on at least a portion of the file and obtaining metadata indicating storage locations for the data in the data storage. For example, the client sends to the file server at least one request for access to a file. In response, the file server grants a lock to the client, and returns to the client metadata of the file including information specifying data storage locations in the network data storage for storing data of the file. The client receives the metadata, and uses the metadata to produce at least one data access command for accessing the data storage locations in the network storage. The client sends the data access command to the network data storage to read or write data to the file. For a write operation, the client may modify the metadata. When the client is finished writing to the file, the client returns any modified metadata to the file server.

    Network file server using a cached disk array storing a network file
directory including file locking information and data mover computers
each having file system software for shared read-write file access
    4.
    发明授权
    Network file server using a cached disk array storing a network file directory including file locking information and data mover computers each having file system software for shared read-write file access 失效
    网络文件服务器使用存储包含文件锁定信息的网络文件目录的缓存磁盘阵列和每个具有用于共享读写文件访问的文件系统软件的数据移动器计算机

    公开(公告)号:US5948062A

    公开(公告)日:1999-09-07

    申请号:US747875

    申请日:1996-11-13

    摘要: For network file access, a plurality of data mover computers are linked to a cached disk array. Read-write files stored in the cached disk array are accessible to network clients through more than one of the data mover computers so that the data mover computers are not a bottleneck to file access. The cached disk array stores a network file directory including file locking information, and the data mover computers each have file system software that accesses the network file directory for shared read-write file access. The data mover computers perform the file system tasks such as managing the file directory for mapping of file names to logical blocks and for locking and unlocking of the files in order to minimize loading on the cached disk array. Therefore, the network file server need not use any particular one of the data mover computers to serve as a control point for read-write file access. Instead, file system software for managing the file directory is replicated in each data mover computer. The cached disk array recognizes logical block addresses, and the cached disk array has a limited internal locking facility ensuring that reading or writing to a logical block is an atomic operation. Preferably the data mover computers are commodity personal computers.

    摘要翻译: 对于网络文件访问,多个数据移动器计算机链接到高速缓存的磁盘阵列。 存储在缓存磁盘阵列中的读写文件可通过多个数据移动计算机访问网络客户端,以便数据移动器计算机不是文件访问的瓶颈。 缓存的磁盘阵列存储包括文件锁定信息的网络文件目录,并且数据移动器计算机各具有访问网络文件目录以获得共享读写文件访问的文件系统软件。 数据移动器计算机执行文件系统任务,例如管理文件目录以将文件名映射到逻辑块,以及用于锁定和解锁文件,以最小化对高速缓存的磁盘阵列的加载。 因此,网络文件服务器不需要使用任何特定的数据移动计算机作为读写文件访问的控制点。 相反,用于管理文件目录的文件系统软件在每个数据移动计算机中被复制。 缓存的磁盘阵列识别逻辑块地址,缓存的磁盘阵列具有有限的内部锁定功能,确保读取或写入逻辑块是原子操作。 优选地,数据移动器计算机是商品个人计算机。

    File server system providing direct data sharing between clients with a server acting as an arbiter and coordinator
    6.
    发明授权
    File server system providing direct data sharing between clients with a server acting as an arbiter and coordinator 有权
    文件服务器系统提供客户端与作为仲裁器和协调器的服务器之间的直接数据共享

    公开(公告)号:US07120631B1

    公开(公告)日:2006-10-10

    申请号:US10032161

    申请日:2001-12-21

    IPC分类号: G06F7/00

    摘要: A client is permitted to send data access commands directly to network data storage of a network file server after obtaining a lock on at least a portion of the file and obtaining metadata indicating storage locations for the data in the data storage. For example, the client sends to the file server at least one request for access to a file. In response, the file server grants a lock to the client, and returns to the client metadata of the file including information specifying data storage locations in the network data storage for storing data of the file. The client receives the metadata, and uses the metadata to produce at least one data access command for accessing the data storage locations in the network storage. The client sends the data access command to the network data storage to read or write data to the file. For a write operation, the client may modify the metadata. When the client is finished writing to the file, the client returns any modified metadata to the file server.

    摘要翻译: 允许客户端在获取对文件的至少一部分的锁定并且获得指示数据存储器中的数据的存储位置的元数据之后,将数据访问命令直接发送到网络文件服务器的网络数据存储器。 例如,客户端向文件服务器发送至少一个访问文件的请求。 作为响应,文件服务器向客户端授予锁定,并且返回到文件的客户端元数据,包括指定用于存储文件的数据的网络数据存储器中的数据存储位置的信息。 客户端接收元数据,并使用元数据产生用于访问网络存储器中的数据存储位置的至少一个数据访问命令。 客户端将数据访问命令发送到网络数据存储器,以将数据读取或写入文件。 对于写操作,客户端可以修改元数据。 当客户端完成写入文件时,客户端将任何修改的元数据返回给文件服务器。

    File server system using connection-oriented protocol and sharing data sets among data movers
    7.
    发明授权
    File server system using connection-oriented protocol and sharing data sets among data movers 有权
    文件服务器系统使用面向连接的协议,并在数据移动器之间共享数据集

    公开(公告)号:US06453354B1

    公开(公告)日:2002-09-17

    申请号:US09261626

    申请日:1999-03-03

    IPC分类号: C06F1516

    CPC分类号: G06F17/30171

    摘要: A first data mover computer services data access requests from a network client, and a second data mover computer is coupled to the first data mover computer for servicing data access requests from the first data mover computer. The first data mover computer uses a connection-oriented protocol to obtain client context information and to respond to a session setup request from the client by authenticating the client. Then the first data mover computer responds to a file system connection request from the client by forwarding the client context information and the file system connection request to the second data mover computer. Then the first data mover computer maintains a connection between the first data mover computer and the second data mover computer when the client accesses the file system and the first data mover computer passes file access requests from the client to the second data mover computer and returns responses to the file access requests from the second data mover computer to the client. In a preferred embodiment, the connection-oriented protocol is the Common Internet File System (CIFS) Protocol, and multiple clients share a Transmission Control Protocol (TCP) connection between the first data mover computer and the second data mover computer by allocation of virtual channels within the shared TCP connection and multiplexing of data packets of the virtual channels over the shared TCP connection.

    摘要翻译: 第一数据移动器计算机服务来自网络客户端的数据访问请求,并且第二数据移动器计算机耦合到第一数据移动器计算机,用于为来自第一数据移动器计算机的数据访问请求提供服务。 第一数据移动器计算机使用面向连接的协议来获得客户端上下文信息并且通过认证客户端来响应来自客户端的会话建立请求。 然后,第一数据移动器计算机通过将客户端上下文信息和文件系统连接请求转发到第二数据移动器计算机来响应来自客户端的文件系统连接请求。 然后,当客户端访问文件系统并且第一数据移动器计算机将文件访问请求从客户端传递到第二数据移动器计算机时,第一数据移动器计算机维护第一数据移动计算机和第二数据移动计算机之间的连接,并且返回响应 将文件访问请求从第二数据移动计算机发送到客户机。 在优选实施例中,面向连接的协议是通用因特网文件系统(CIFS)协议,并且多个客户端通过分配虚拟信道来共享第一数据移动器计算机和第二数据移动器计算机之间的传输控制协议(TCP)连接 在共享TCP连接中并通过共享TCP连接复用虚拟通道的数据包。

    Video file server maintaining sliding windows of a video data set in
random access memories of stream server computers for immediate
video-on-demand service beginning at any specified location
    8.
    发明授权
    Video file server maintaining sliding windows of a video data set in random access memories of stream server computers for immediate video-on-demand service beginning at any specified location 失效
    视频文件服务器保持流服务器计算机的随机存取存储器中的视频数据集的滑动窗口,用于从任何指定位置开始的即时视频点播服务

    公开(公告)号:US5933603A

    公开(公告)日:1999-08-03

    申请号:US661053

    申请日:1996-06-10

    摘要: A video file server includes an integrated cached disk array storage subsystem and a plurality of stream server computers linking the cached disk storage subsystem to a data network for the transfer of video data streams. The video file server further includes a server controller for applying an admission control policy to client requests and assigning stream servers to service the client requests. The stream servers include a real-time scheduler for scheduling isochronous tasks, and supports at least one industry standard network file access protocol and one file access protocol for continuous media file access. The cached disk storage subsystem is responsive to video prefetch commands, and the data specified for a prefetch command for a process are retained in an allocated portion of the cache memory from the time that the cached disk storage subsystem has responded to the prefetch command to the time that the cached disk storage subsystem responds to a fetch command specifying the data for the process. The time between prefetching and fetching is selected based on available disk and cache resources. The video file server provides video-on-demand service by maintaining and dynamically allocating sliding windows of video data in the random access memories of the stream server computers.

    摘要翻译: 视频文件服务器包括集成缓存的磁盘阵列存储子系统和将高速缓存的磁盘存储子系统链接到用于传输视频数据流的数据网络的多个流服务器计算机。 该视频文件服务器还包括服务器控制器,用于向客户端请求应用准入控制策略,并分配流服务器来服务客户端请求。 流服务器包括用于调度等时任务的实时调度器,并且支持至少一个工业标准网络文件访问协议和用于连续媒体文件访问的一个文件访问协议。 缓存的磁盘存储子系统响应于视频预取命令,并且对于进程的预取命令指定的数据从缓存的磁盘存储子系统对预取命令作出响应的时间保留在高速缓冲存储器的分配部分中 缓存磁盘存储子系统响应指定进程数据的fetch命令的时间。 基于可用的磁盘和缓存资源选择预取和提取之间的时间。 视频文件服务器通过维护和动态地分配流服务器计算机的随机存取存储器中的视频数据的滑动窗口来提供视频点播服务。

    Network file server sharing local caches of file access information in data processors assigned to respective file systems
    9.
    发明授权
    Network file server sharing local caches of file access information in data processors assigned to respective file systems 有权
    网络文件服务器在分配给相应文件系统的数据处理器中共享文件访问信息的本地缓存

    公开(公告)号:US07739379B1

    公开(公告)日:2010-06-15

    申请号:US10871600

    申请日:2004-06-18

    CPC分类号: G06F17/30171

    摘要: A network file server includes a first set of data processors for receiving requests from clients, and a second set of data processors for accessing read-write file systems. A respective data processor in the second set is assigned to each file system for exclusive management of read and write locks on the file system. Each data processor in the first set can authorize access to file systems directly accessed by more than one data processor in the second set. Processing of a request for access that is authorized is continued by the data processor that is assigned to manage the locks on the file system to be accessed. The exclusivity of lock management eliminates cache coherency problems, and dynamic load balancing can be used to prevent the lock management from becoming a bottleneck to performance. A preferred embodiment includes a cached disk storage subsystem linked to data mover computers. Each data mover has authorization and ownership information for a plurality of file systems, and maintains a local cache of locking information for file systems that the data mover can directly access. The data mover receives a client request, and if access is authorized, checks whether it can directly access the file, and if not, forwards the request to another data mover.

    摘要翻译: 网络文件服务器包括用于接收来自客户端的请求的第一组数据处理器和用于访问读写文件系统的第二组数据处理器。 第二组中的相应数据处理器被分配给每个文件系统,用于对文件系统上的读取和写入锁定进行排他性管理。 第一组中的每个数据处理器可以授权访问由第二组中的多个数据处理器直接访问的文件系统。 被授权的访问请求的处理由被分配用于管理要访问的文件系统上的锁的数据处理器继续。 锁管理的排他性消除了缓存一致性问题,动态负载平衡可以用来防止锁管理成为性能的瓶颈。 优选实施例包括链接到数据移动器计算机的高速缓存的磁盘存储子系统。 每个数据移动器具有用于多个文件系统的授权和所有权信息,并维护数据移动者可以直接访问的文件系统的锁定信息的本地缓存。 数据移动器接收客户端请求,如果访问被授权,则检查它是否可以直接访问该文件,如果不是,则将该请求转发给另一个数据移动器。

    File server system using file system storage, data movers, and an exchange of meta data among data movers for file locking and direct access to shared file systems
    10.
    发明授权
    File server system using file system storage, data movers, and an exchange of meta data among data movers for file locking and direct access to shared file systems 有权
    文件服务器系统使用文件系统存储,数据移动器和数据移动器之间的元数据交换进行文件锁定和直接访问共享文件系统

    公开(公告)号:US06324581B1

    公开(公告)日:2001-11-27

    申请号:US09261542

    申请日:1999-03-03

    IPC分类号: G06F1516

    摘要: A plurality of data mover computers control access to respective file systems in data storage. A network client serviced by any of the data movers can access each of the file systems. If a data mover receives a client request for access to a file in a file system to which access is controlled by another data mover, then the data mover that received the client request sends a metadata request to the data mover that controls access to the file system. The data mover that controls access to the file system responds by placing a lock on the file and returning metadata of the file. The data mover that received the client request uses the metadata to formulate a data access command that is used to access the file data in the file system over a bypass data path that bypasses the data mover computer that controls access to the file system.

    摘要翻译: 多个数据移动器计算机控制对数据存储中的相应文件系统的访问。 由任何数据移动器服务的网络客户机可以访问每个文件系统。 如果数据移动者接收到访问由另一个数据移动器控制访问的文件系统中的文件的客户端请求,则接收到客户端请求的数据移动器向控制对该文件的访问的数据移动器发送元数据请求 系统。 控制对文件系统访问的数据移动器通过对文件进行锁定并返回文件的元数据来做出响应。 接收客户端请求的数据移动器使用元数据来制定数据访问命令,该命令用于通过旁路数据路径访问文件系统中的文件数据,旁路数据路径绕过控制对文件系统的访问的数据移动器计算机。