Object classification and indexing of very large name spaces using grid technology
    1.
    发明授权
    Object classification and indexing of very large name spaces using grid technology 有权
    使用网格技术的非常大的名称空间的对象分类和索引

    公开(公告)号:US07672981B1

    公开(公告)日:2010-03-02

    申请号:US11680618

    申请日:2007-02-28

    IPC分类号: G06F17/30

    摘要: For migration or de-duplication of a file system having a large number of files, a utility program traverses the file system to create a log of file-specific information about the file system. For identification of duplicates, the utility program produces a signature for each file. Respective instances of the utility program are started on multiple nodes upon which the file system is mounted. A fully qualified pathname is compiled during transfer of the log to a database. Multiple databases can be produced for the file system such that each database contains the file-specific information for a specified range of inode numbers. The database also maintains classification state for each file. For example, for a migration or replication process, the classification state identifies whether or not the file has been untouched, copied, linked, secondary-ized, source deleted, or modified.

    摘要翻译: 对于具有大量文件的文件系统的迁移或重复数据删除,实用程序遍历文件系统以创建关于文件系统的文件特定信息的日志。 为了识别重复项,实用程序为每个文件生成签名。 实用程序的各个实例在安装文件系统的多个节点上启动。 在将日志传输到数据库期间,将编译完全限定的路径名​​。 可以为文件系统生成多个数据库,以便每个数据库包含指定范围的inode编号的文件特定信息。 数据库还维护每个文件的分类状态。 例如,对于迁移或复制过程,分类状态标识文件是否已被保护,复制,链接,二次化,源删除或修改。

    Automatic access management of clients to a storage system
    2.
    发明授权
    Automatic access management of clients to a storage system 有权
    自动访问客户端到存储系统

    公开(公告)号:US08555014B1

    公开(公告)日:2013-10-08

    申请号:US12005640

    申请日:2007-12-27

    IPC分类号: G06F12/00

    摘要: Embodiments of the present invention provide a method of managing access of multiple client computers to a storage system that supports a limited number of logins. The method comprises, in response to a request to enable a subset of the clients to access resources of the storage system to perform a task, automatically configuring the storage system to provide the subset of the clients access to the resources, and, when the task is completed, automatically re-configuring the storage system so that the subset of the clients is no longer provided with access to the resources of the storage system.

    摘要翻译: 本发明的实施例提供了一种管理多个客户端计算机到支持有限数量登录的存储系统的访问的方法。 该方法包括响应于使得客户端子集能够访问存储系统的资源以执行任务的请求,自动地配置存储系统以提供客户端子集对资源的访问,以及当任务 完成后,自动重新配置存储系统,以便客户端的子集不再被提供给存储系统资源的访问。

    Access control to block storage devices for a shared disk based file system
    3.
    发明授权
    Access control to block storage devices for a shared disk based file system 有权
    访问控制以阻止基于共享磁盘的文件系统的存储设备

    公开(公告)号:US08086585B1

    公开(公告)日:2011-12-27

    申请号:US12242618

    申请日:2008-09-30

    IPC分类号: G06F17/30

    CPC分类号: G06F17/30097 G06F17/30171

    摘要: For enhanced access control, a client includes a token in each read or write command sent to a block storage device. The block storage device evaluates the token to determine whether or not read or write access is permitted at a specified logical block address. For example, the token is included in the logical block address field of a SCSI read or write command. The client may compute the token as a function of the logical block address of a data block to be accessed, or a metadata server may include the token in each block address of each extent reported to the client in response to a metadata request. For enhanced security, the token also is a function of a client identifier, a logical unit number, and access rights of the client to a particular extent of file system data blocks.

    摘要翻译: 对于增强的访问控制,客户端在发送到块存储设备的每个读取或写入命令中包含令牌。 块存储设备评估令牌以确定在指定的逻辑块地址是否允许读取或写入访问。 例如,令牌包含在SCSI读或写命令的逻辑块地址字段中。 客户端可以根据要访问的数据块的逻辑块地址来计算令牌,或者元数据服务器可以响应于元​​数据请求向客户端报告的每个区段的每个块地址中包括令牌。 为了增强安全性,令牌还是客户端标识符,逻辑单元号以及客户端对文件系统数据块的特定范围的访问权限的函数。

    Shared storage access load balancing for a large number of hosts
    4.
    发明授权
    Shared storage access load balancing for a large number of hosts 有权
    为大量主机共享存储访问负载平衡

    公开(公告)号:US08819344B1

    公开(公告)日:2014-08-26

    申请号:US11836735

    申请日:2007-08-09

    IPC分类号: G06F12/10

    摘要: A data processing system includes host data processors, a data storage system including data storage shared among the host data processors, and a data switch coupling the host data processors to the data storage system. The data storage system has host adapter ports coupled to the data switch. The data switch is programmed for distributing block I/O requests from the host data processors over the operable host adapter ports for load balancing of the block I/O requests among the operable host adapter ports. The shared data storage can be a file system striped across RAID sets of disk drives for load balancing upon disk director ports of the data storage system. The data processing system can be expanded by adding more data storage systems, switches for the additional data storage systems, and switches for routing block I/O requests from the host processors to the data storage systems.

    摘要翻译: 数据处理系统包括主机数据处理器,包括在主机数据处理器之间共享的数据存储器的数据存储系统以及将主机数据处理器耦合到数据存储系统的数据交换机。 数据存储系统具有耦合到数据交换机的主机适配器端口。 数据交换机被编程为通过可操作的主机适配器端口从主机数据处理器分发块I / O请求,以便在可操作的主机适配器端口之间进行块I / O请求的负载平衡。 共享数据存储可以是跨RAID磁盘阵列分割的文件系统,用于在数据存储系统的磁盘导向器端口上进行负载平衡。 可以通过添加更多的数据存储系统,用于附加数据存储系统的交换机和用于将块I / O请求从主机处理器路由到数据存储系统的交换机来扩展数据处理系统。

    System and method for providing access control to raw shared devices
    5.
    发明授权
    System and method for providing access control to raw shared devices 有权
    为原始共享设备提供访问控制的系统和方法

    公开(公告)号:US07930487B1

    公开(公告)日:2011-04-19

    申请号:US11854616

    申请日:2007-09-13

    IPC分类号: G06F12/00

    CPC分类号: G06F21/805

    摘要: An access control agent is advantageously deployed at a host device to prevent malicious use of a storage system by unauthorized hosts and users. In one embodiment the access control agent is disposed in a processing path between the application and the storage device. An application is mounted as an image file by a loop device to provide a virtual file system. The virtual file system is populated with access control information for each block of the file. Application I/O requests are mapped to physical blocks of the storage by the loop device, and the access control information is used to filter the access requests to preclude unauthorized requests from being forwarded to the storage client (and consequently the storage devices). With such an arrangement, access rights can be determined at I/O accesses, file and block granularity for each user.

    摘要翻译: 访问控制代理有利地部署在主机设备中,以防止未经授权的主机和用户恶意使用存储系统。 在一个实施例中,访问控制代理被布置在应用程序和存储设备之间的处理路径中。 应用程序通过循环设备作为映像文件安装,以提供虚拟文件系统。 虚拟文件系统填充有文件的每个块的访问控制信息。 应用程序I / O请求被环路设备映射到存储的物理块,并且访问控制信息用于过滤访问请求,以防止未经授权的请求被转发到存储客户端(以及因此存储设备)。 通过这样的安排,可以在I / O访问,每个用户的文件和块粒度上确定访问权限。

    File server system having tiered storage including solid-state drive primary storage and magnetic disk drive secondary storage
    6.
    发明授权
    File server system having tiered storage including solid-state drive primary storage and magnetic disk drive secondary storage 有权
    文件服务器系统具有分层存储,包括固态硬盘主存储和磁盘驱动器二次存储

    公开(公告)号:US09213721B1

    公开(公告)日:2015-12-15

    申请号:US12348866

    申请日:2009-01-05

    IPC分类号: G06F7/00 G06F17/30

    CPC分类号: G06F17/30221

    摘要: A file server system having solid-state drive primary storage and magnetic disk drive secondary storage aggressively moves newly created files from the primary storage to selected file systems in the secondary storage to match expected access patterns upon the files to different configurations of the file systems and for load balancing upon the file systems in the secondary storage. Upon read access to a file that has been moved to the secondary storage, or upon migration of a newly created file that was read in primary storage after creation, a corresponding stub file containing file mapping metadata is created in the primary storage. The file mapping metadata in the stub file maps the extent of the file to logical storage addresses in the secondary storage.

    摘要翻译: 具有固态驱动器主存储器和磁盘驱动器辅助存储器的文件服务器系统将新创建的文件从主存储器大量移动到辅助存储器中的选定文件系统,以将文件上的预期访问模式与文件系统的不同配置相匹配, 用于在二级存储器中的文件系统上进行负载平衡。 在读取访问已被移动到辅助存储器的文件之后,或者在创建之后迁移新创建的在主存储器中读取的文件时,将在主存储器中创建包含文件映射元数据的对应存根文件。 存根文件中的文件映射元数据将文件的范围映射到辅助存储中的逻辑存储地址。

    Request queues for interactive clients in a shared file system of a parallel computing system
    7.
    发明授权
    Request queues for interactive clients in a shared file system of a parallel computing system 有权
    在并行计算系统的共享文件系统中为交互式客户端请求队列

    公开(公告)号:US09110695B1

    公开(公告)日:2015-08-18

    申请号:US13730112

    申请日:2012-12-28

    IPC分类号: G06F9/455

    摘要: Interactive requests are processed from users of log-in nodes. A metadata server node is provided for use in a file system shared by one or more interactive nodes and one or more batch nodes. The interactive nodes comprise interactive clients to execute interactive tasks and the batch nodes execute batch jobs for one or more batch clients. The metadata server node comprises a virtual machine monitor; an interactive client proxy to store metadata requests from the interactive clients in an interactive client queue; a batch client proxy to store metadata requests from the batch clients in a batch client queue; and a metadata server to store the metadata requests from the interactive client queue and the batch client queue in a metadata queue based on an allocation of resources by the virtual machine monitor. The metadata requests can be prioritized, for example, based on one or more of a predefined policy and predefined rules.

    摘要翻译: 从登录节点的用户处理交互式请求。 提供元数据服务器节点用于由一个或多个交互式节点和一个或多个批处理节点共享的文件系统。 交互式节点包括交互式客户端以执行交互式任务,批处理节点为一个或多个批处理客户端执行批处理作业。 元数据服务器节点包括虚拟机监视器; 交互式客户端代理,用于在交互式客户端队列中存储来自交互式客户机的元数据请求; 批处理客户机代理,用于在批处理客户端队列中存储批处理客户端的元数据请求; 以及元数据服务器,用于基于虚拟机监视器的资源分配来存储元数据队列中来自交互式客户机队列和批处理客户机队列的元数据请求。 元数据请求可以被优先化,例如,基于预定义策略和预定义规则中的一个或多个。

    Application aware intelligent storage system
    8.
    发明授权
    Application aware intelligent storage system 有权
    应用感知智能存储系统

    公开(公告)号:US08429307B1

    公开(公告)日:2013-04-23

    申请号:US12826749

    申请日:2010-06-30

    IPC分类号: G06F3/00

    摘要: This invention is a system and a method for operating a storage server that provides read or write access to a data in a data network using a new architecture. The method of processing I/Os in response to a request by a client of the storage server executes one or more services communicated by a policy engine. The I/Os received from the application are tagged and catalogued to create co-related I/O patterns. The policy engine is then updated with the results of processing the I/Os after executing services on those I/Os.

    摘要翻译: 本发明是一种用于操作存储服务器的系统和方法,该存储服务器使用新架构提供对数据网络中的数据的读取或写入访问。 响应于存储服务器的客户端的请求来处理I / O的方法执行由策略引擎传送的一个或多个服务。 从应用程序接收的I / O被标记和编目,以创建共同相关的I / O模式。 然后在执行这些I / O上的服务之后,更新处理I / O的结果的策略引擎。

    Servicing interrupts and scheduling code thread execution in a multi-CPU network file server
    9.
    发明授权
    Servicing interrupts and scheduling code thread execution in a multi-CPU network file server 有权
    在多CP​​U网络文件服务器中服务中断和调度代码线程执行

    公开(公告)号:US08180973B1

    公开(公告)日:2012-05-15

    申请号:US12646457

    申请日:2009-12-23

    IPC分类号: G06F12/00

    CPC分类号: G06F9/5033 G06F9/4812

    摘要: Interrupts and code threads are assigned in a particular way to the core CPUs of a network file server in order to reduce latency for processing client requests for file access. Threads of the network stack are incorporated into real time threads that are scheduled by a real-time scheduler and executed exclusively by a plurality of the core CPUs that are not interrupted by disk adapter interrupts so that the disk adapter interrupts do not interrupt execution of the network stack. Instances of a storage access driver are hard affinity threads, and soft affinity threads include a multitude of instances of a thread of the file system stack for file access request processing so that file access request processing for a multitude of concurrent file access requests is load balanced over the core CPUs.

    摘要翻译: 中断和代码线程以特定方式分配给网络文件服务器的核心CPU,以减少处理客户端文件访问请求的延迟。 网络堆栈的线程被并入由实时调度器调度并由不被磁盘适配器中断中断的多个核心CPU执行的实时线程中,由此磁盘适配器中断不中断执行 网络堆栈 存储访问驱动程序的实例是硬密切关系线程,并且软亲和线程包括用于文件访问请求处理的文件系统栈的线程的多个实例,使得用于多个并发文件访问请求的文件访问请求处理被负载平衡 在核心CPU上。

    Intelligent file system based power management for shared storage that migrates groups of files based on inactivity threshold
    10.
    发明授权
    Intelligent file system based power management for shared storage that migrates groups of files based on inactivity threshold 有权
    基于智能文件系统的共享存储的电源管理,可以基于不活动阈值迁移文件组

    公开(公告)号:US08006111B1

    公开(公告)日:2011-08-23

    申请号:US11859100

    申请日:2007-09-21

    IPC分类号: G06F1/32

    摘要: A file server includes active storage containing frequently accessed files, and active/inactive disk drives for containing infrequently accessed files. Groups of the files having become inactive in the active storage are successively migrated to respective evacuated active/inactive disk drives so that each active/inactive disk drive is loaded with files having a similar probability of access when access to the active/inactive disk drive reaches an inactivity threshold for powering down the active/inactive disk drive. Storage of the active/inactive disk drives is reclaimed when an oldest group of the files is archived or when an active/inactive disk drive is evacuated by migrating files from the active/inactive disk drive to storage having been released in other disk drives by promotion of files for client access to the promoted files. Therefore, recovery of storage can be planned and scheduled in advance and performed efficiently in a background process.

    摘要翻译: 文件服务器包括包含经常访问的文件的活动存储器,以及用于包含不经常访问的文件的主动/非活动磁盘驱动器。 在活动存储器中变得不活动的文件组被依次迁移到相应的撤离的活动/非活动磁盘驱动器,使得当访问活动/非活动磁盘驱动器到达时,每个活动/非活动磁盘驱动器被加载具有相似的访问概率的文件 用于关闭主动/非活动磁盘驱动器的非活动阈值。 当归档最旧的文件组或通过将活动/非活动磁盘驱动器中的文件迁移到已经通过宣传释放到其他磁盘驱动器中的存储而将主动/不活动磁盘驱动器撤离时,将回收活动/非活动磁盘驱动器的存储 的文件,以便客户端访问升级的文件。 因此,可以预先规划和调度存储的恢复并且在后台进程中有效地执行。