Method and apparatus for selection between multiple candidate clouds for job processing

    公开(公告)号:US09979780B1

    公开(公告)日:2018-05-22

    申请号:US13532132

    申请日:2012-06-25

    IPC分类号: G06F15/173 H04L29/08

    摘要: A processing device of an information processing system is configured to identify different candidate clouds for performing a processing job for a requesting user, to collect respective sets of parameters from the different candidate clouds with each such set of parameters characterizing at least one aspect of a manner in which the processing job would be performed in the corresponding candidate cloud, and to compile information characterizing the collected sets of parameters so as to permit informed selection by the requesting user or another system entity of at least a particular one of the candidate clouds for performing the processing job. The processing device may be further configured to permit the requesting user to monitor and/or control the processing job as it is executing in the selected cloud(s). For example, warnings may be provided to the user if execution of the processing job is not meeting specified user requirements.

    Multi-site storage system with replicated file system synchronization utilizing virtual block storage appliances
    2.
    发明授权
    Multi-site storage system with replicated file system synchronization utilizing virtual block storage appliances 有权
    具有使用虚拟块存储设备的复制文件系统同步的多站点存储系统

    公开(公告)号:US09582559B1

    公开(公告)日:2017-02-28

    申请号:US13537163

    申请日:2012-06-29

    摘要: One or more processing platforms are configured to implement at least a first site of a multi-site storage system. The first site comprises a first file system resident at the first site, and a replicated version of a second file system. The second file system is resident at a second site of the multi-site storage system, and the replicated version of the second file system is resident at the first site. Virtual block storage appliances running on respective virtual machines of the first site interact with one another and with similar appliances at the second site to allow the replicated version of the second file system to be synchronized at a cache level with the second file system, and to allow a replicated version of the first file system at the second site to be synchronized at a cache level with the first file system at the first site.

    摘要翻译: 一个或多个处理平台被配置为实现多站点存储系统的至少第一站点。 第一站点包括驻留在第一站点的第一文件系统和第二文件系统的复制版本。 第二文件系统驻留在多站点存储系统的第二站点,并且第二文件系统的复制版本驻留在第一站点。 运行在第一站点的相应虚拟机上的虚拟块存储设备彼此交互并且与第二站点处的类似设备进行交互,以允许第二文件系统的复制版本在与第二文件系统的高速缓存级别同步,并且 允许在第二站点的第一个文件系统的复制版本与第一个站点上的第一个文件系统的缓存级别同步。

    File server system having tiered storage including solid-state drive primary storage and magnetic disk drive secondary storage
    3.
    发明授权
    File server system having tiered storage including solid-state drive primary storage and magnetic disk drive secondary storage 有权
    文件服务器系统具有分层存储,包括固态硬盘主存储和磁盘驱动器二次存储

    公开(公告)号:US09213721B1

    公开(公告)日:2015-12-15

    申请号:US12348866

    申请日:2009-01-05

    IPC分类号: G06F7/00 G06F17/30

    CPC分类号: G06F17/30221

    摘要: A file server system having solid-state drive primary storage and magnetic disk drive secondary storage aggressively moves newly created files from the primary storage to selected file systems in the secondary storage to match expected access patterns upon the files to different configurations of the file systems and for load balancing upon the file systems in the secondary storage. Upon read access to a file that has been moved to the secondary storage, or upon migration of a newly created file that was read in primary storage after creation, a corresponding stub file containing file mapping metadata is created in the primary storage. The file mapping metadata in the stub file maps the extent of the file to logical storage addresses in the secondary storage.

    摘要翻译: 具有固态驱动器主存储器和磁盘驱动器辅助存储器的文件服务器系统将新创建的文件从主存储器大量移动到辅助存储器中的选定文件系统,以将文件上的预期访问模式与文件系统的不同配置相匹配, 用于在二级存储器中的文件系统上进行负载平衡。 在读取访问已被移动到辅助存储器的文件之后,或者在创建之后迁移新创建的在主存储器中读取的文件时,将在主存储器中创建包含文件映射元数据的对应存根文件。 存根文件中的文件映射元数据将文件的范围映射到辅助存储中的逻辑存储地址。

    Request queues for interactive clients in a shared file system of a parallel computing system
    4.
    发明授权
    Request queues for interactive clients in a shared file system of a parallel computing system 有权
    在并行计算系统的共享文件系统中为交互式客户端请求队列

    公开(公告)号:US09110695B1

    公开(公告)日:2015-08-18

    申请号:US13730112

    申请日:2012-12-28

    IPC分类号: G06F9/455

    摘要: Interactive requests are processed from users of log-in nodes. A metadata server node is provided for use in a file system shared by one or more interactive nodes and one or more batch nodes. The interactive nodes comprise interactive clients to execute interactive tasks and the batch nodes execute batch jobs for one or more batch clients. The metadata server node comprises a virtual machine monitor; an interactive client proxy to store metadata requests from the interactive clients in an interactive client queue; a batch client proxy to store metadata requests from the batch clients in a batch client queue; and a metadata server to store the metadata requests from the interactive client queue and the batch client queue in a metadata queue based on an allocation of resources by the virtual machine monitor. The metadata requests can be prioritized, for example, based on one or more of a predefined policy and predefined rules.

    摘要翻译: 从登录节点的用户处理交互式请求。 提供元数据服务器节点用于由一个或多个交互式节点和一个或多个批处理节点共享的文件系统。 交互式节点包括交互式客户端以执行交互式任务,批处理节点为一个或多个批处理客户端执行批处理作业。 元数据服务器节点包括虚拟机监视器; 交互式客户端代理,用于在交互式客户端队列中存储来自交互式客户机的元数据请求; 批处理客户机代理,用于在批处理客户端队列中存储批处理客户端的元数据请求; 以及元数据服务器,用于基于虚拟机监视器的资源分配来存储元数据队列中来自交互式客户机队列和批处理客户机队列的元数据请求。 元数据请求可以被优先化,例如,基于预定义策略和预定义规则中的一个或多个。

    Application aware intelligent storage system
    5.
    发明授权
    Application aware intelligent storage system 有权
    应用感知智能存储系统

    公开(公告)号:US08429307B1

    公开(公告)日:2013-04-23

    申请号:US12826749

    申请日:2010-06-30

    IPC分类号: G06F3/00

    摘要: This invention is a system and a method for operating a storage server that provides read or write access to a data in a data network using a new architecture. The method of processing I/Os in response to a request by a client of the storage server executes one or more services communicated by a policy engine. The I/Os received from the application are tagged and catalogued to create co-related I/O patterns. The policy engine is then updated with the results of processing the I/Os after executing services on those I/Os.

    摘要翻译: 本发明是一种用于操作存储服务器的系统和方法,该存储服务器使用新架构提供对数据网络中的数据的读取或写入访问。 响应于存储服务器的客户端的请求来处理I / O的方法执行由策略引擎传送的一个或多个服务。 从应用程序接收的I / O被标记和编目,以创建共同相关的I / O模式。 然后在执行这些I / O上的服务之后,更新处理I / O的结果的策略引擎。

    Servicing interrupts and scheduling code thread execution in a multi-CPU network file server
    6.
    发明授权
    Servicing interrupts and scheduling code thread execution in a multi-CPU network file server 有权
    在多CP​​U网络文件服务器中服务中断和调度代码线程执行

    公开(公告)号:US08180973B1

    公开(公告)日:2012-05-15

    申请号:US12646457

    申请日:2009-12-23

    IPC分类号: G06F12/00

    CPC分类号: G06F9/5033 G06F9/4812

    摘要: Interrupts and code threads are assigned in a particular way to the core CPUs of a network file server in order to reduce latency for processing client requests for file access. Threads of the network stack are incorporated into real time threads that are scheduled by a real-time scheduler and executed exclusively by a plurality of the core CPUs that are not interrupted by disk adapter interrupts so that the disk adapter interrupts do not interrupt execution of the network stack. Instances of a storage access driver are hard affinity threads, and soft affinity threads include a multitude of instances of a thread of the file system stack for file access request processing so that file access request processing for a multitude of concurrent file access requests is load balanced over the core CPUs.

    摘要翻译: 中断和代码线程以特定方式分配给网络文件服务器的核心CPU,以减少处理客户端文件访问请求的延迟。 网络堆栈的线程被并入由实时调度器调度并由不被磁盘适配器中断中断的多个核心CPU执行的实时线程中,由此磁盘适配器中断不中断执行 网络堆栈 存储访问驱动程序的实例是硬密切关系线程,并且软亲和线程包括用于文件访问请求处理的文件系统栈的线程的多个实例,使得用于多个并发文件访问请求的文件访问请求处理被负载平衡 在核心CPU上。

    Intelligent file system based power management for shared storage that migrates groups of files based on inactivity threshold
    7.
    发明授权
    Intelligent file system based power management for shared storage that migrates groups of files based on inactivity threshold 有权
    基于智能文件系统的共享存储的电源管理,可以基于不活动阈值迁移文件组

    公开(公告)号:US08006111B1

    公开(公告)日:2011-08-23

    申请号:US11859100

    申请日:2007-09-21

    IPC分类号: G06F1/32

    摘要: A file server includes active storage containing frequently accessed files, and active/inactive disk drives for containing infrequently accessed files. Groups of the files having become inactive in the active storage are successively migrated to respective evacuated active/inactive disk drives so that each active/inactive disk drive is loaded with files having a similar probability of access when access to the active/inactive disk drive reaches an inactivity threshold for powering down the active/inactive disk drive. Storage of the active/inactive disk drives is reclaimed when an oldest group of the files is archived or when an active/inactive disk drive is evacuated by migrating files from the active/inactive disk drive to storage having been released in other disk drives by promotion of files for client access to the promoted files. Therefore, recovery of storage can be planned and scheduled in advance and performed efficiently in a background process.

    摘要翻译: 文件服务器包括包含经常访问的文件的活动存储器,以及用于包含不经常访问的文件的主动/非活动磁盘驱动器。 在活动存储器中变得不活动的文件组被依次迁移到相应的撤离的活动/非活动磁盘驱动器,使得当访问活动/非活动磁盘驱动器到达时,每个活动/非活动磁盘驱动器被加载具有相似的访问概率的文件 用于关闭主动/非活动磁盘驱动器的非活动阈值。 当归档最旧的文件组或通过将活动/非活动磁盘驱动器中的文件迁移到已经通过宣传释放到其他磁盘驱动器中的存储而将主动/不活动磁盘驱动器撤离时,将回收活动/非活动磁盘驱动器的存储 的文件,以便客户端访问升级的文件。 因此,可以预先规划和调度存储的恢复并且在后台进程中有效地执行。

    Selection of a data path based on one or more performance characteristics of a computer system
    9.
    发明授权
    Selection of a data path based on one or more performance characteristics of a computer system 有权
    基于计算机系统的一个或多个性能特征来选择数据路径

    公开(公告)号:US07688753B1

    公开(公告)日:2010-03-30

    申请号:US11966662

    申请日:2007-12-28

    IPC分类号: H04L12/26

    摘要: Embodiments of the present invention are directed to techniques for selecting a data path over which to exchange information between a client device and a storage system by making a selection between a file system server (NAS) data path type (a first data path type) and a direct (SAN) data path type (a second data path type) based on one or more adjustable path selection factors and/or information regarding components of the computer system. For example, a data path may be selected based on one or more performance characteristics of a computer system in which a path selection module is acting and/or any other suitable path selection factor.

    摘要翻译: 本发明的实施例涉及用于通过在文件系统服务器(NAS)数据路径类型(第一数据路径类型)和第二数据路径类型之间进行选择来选择在客户端设备和存储系统之间交换信息的数据路径的技术 基于一个或多个可调节路径选择因素的直接(SAN)数据路径类型(第二数据路径类型)和/或关于计算机系统的组件的信息。 例如,可以基于路径选择模块所在的计算机系统的一个或多个性能特征和/或任何其他合适的路径选择因素来选择数据路径。

    Metadata offload for a file server cluster
    10.
    发明授权
    Metadata offload for a file server cluster 有权
    文件服务器集群的元数据卸载

    公开(公告)号:US07617216B2

    公开(公告)日:2009-11-10

    申请号:US11220780

    申请日:2005-09-07

    IPC分类号: G06F17/30

    CPC分类号: G06F17/30194 G06F17/30082

    摘要: A file server system has a cluster of server computers that share access to a file system in shared storage. One of the server computers has primary responsibility for management of access to the file system. In order to reduce the possibility of primary server overload when a large number of the clients happen to concurrently access the same file system, most metadata processing operations are offloaded to secondary server computers. This also facilitates recovery from failure of a primary server computer since only a fraction of the ongoing metadata operations of a primary server computer is interrupted by a failure of the primary server computer. For example, a secondary data mover may truncate, delete, create, or rename a file in response to a client request.

    摘要翻译: 文件服务器系统具有共享对共享存储器中的文件系统的访问的服务器计算机集群。 其中一台服务器计算机主要负责管理对文件系统的访问。 为了减少当大量客户端并发访问同一文件系统时主服务器过载的可能性,大多数元数据处理操作都被卸载到辅助服务器计算机。 这还有助于从主服务器计算机的故障恢复,因为主服务器计算机的正在进行的元数据操作的一小部分被主服务器计算机的故障中断。 例如,辅助数据移动器可以截断,删除,创建或重命名文件以响应客户端请求。