Multi-class storage mechanism
    1.
    发明授权
    Multi-class storage mechanism 有权
    多级存储机制

    公开(公告)号:US07225211B1

    公开(公告)日:2007-05-29

    申请号:US10750597

    申请日:2003-12-31

    IPC分类号: G06F17/30

    摘要: System and method for implementing a file system across different storage classes in a storage system. Embodiments may define multiple classes of storage and automatically and transparently migrate data in the storage classes within the same file system to meet the usage needs of the business. Embodiments may transparently adapt the cost of storage to the usage patterns of data on the storage, thereby reducing the amount that customers need to spend for their storage. In embodiments, storage devices may be classified into different classes of storage to implement a multi-class file system. Embodiments may provide a multi-class storage mechanism for managing and implementing user-defined policies for assigning and migrating data within the multi-class file system. The multi-class storage mechanism may determine where to initially place data, and may transparently migrate data to other storage classes according to the policies. Migrated data remains online within the file system.

    摘要翻译: 用于在存储系统中跨不同存储类实现文件系统的系统和方法。 实施例可以定义多个类别的存储,并且在相同文件系统内的存储类中自动且透明地迁移数据以满足业务的使用需要。 实施例可以将存储成本透明地适应存储器上的数据的使用模式,从而减少客户为其存储而花费的金额。 在实施例中,存储设备可以被分类成不同类别的存储以实现多类文件系统。 实施例可以提供用于管理和实现用于在多类文件系统内分配和迁移数据的用户定义的策略的多类存储机制。 多级存储机制可以确定最初放置数据的位置,并且可以根据策略透明地将数据迁移到其他存储类。 迁移的数据在文件系统中保持联机。

    Restore mechanism for a multi-class file system
    2.
    发明授权
    Restore mechanism for a multi-class file system 有权
    多类文件系统的恢复机制

    公开(公告)号:US08127095B1

    公开(公告)日:2012-02-28

    申请号:US10749279

    申请日:2003-12-31

    IPC分类号: G06F12/08

    摘要: System and method for performing optimized restores of a multi-class file system. More actively accessed data may be assigned to higher storage classes and less actively accessed data may be assigned to lower storage classes in the multi-class file system. In a restore, the higher storage class(es) including more actively accessed data may be restored first. The multi-class file system may then be brought online for access by application(s). The lower storage class(es) may then be restored. In one embodiment, if a request for data that have not been restored is received, the file system may obtain an estimated time until restore of the requested data from the restore mechanism. The file system may then notify the application of the estimated time until restore. The application may notify a user of the estimated time, and may generate another request for the data after the estimated time has elapsed.

    摘要翻译: 用于执行多类文件系统的优化恢复的系统和方法。 可以将更主动访问的数据分配给较高的存储类别,并且较少主动访问的数据可以被分配给多类文件系统中的较低存储类别。 在还原中,可以首先恢复包括更主动访问的数据的较高存储类。 然后可以将多类文件系统联机以供应用程序访问。 然后可以恢复较低的存储类。 在一个实施例中,如果接收到尚未被恢复的数据的请求,则文件系统可以获得从恢复机制恢复所请求的数据的估计时间。 然后,文件系统可以通知应用程序到恢复之前的估计时间。 应用程序可以通知用户估计的时间,并且可以在经过估计时间之后产生对数据的另一请求。

    Performing operations without requiring split mirrors in a multi-class file system
    3.
    发明授权
    Performing operations without requiring split mirrors in a multi-class file system 有权
    在多类文件系统中执行不需要拆分镜像的操作

    公开(公告)号:US07293133B1

    公开(公告)日:2007-11-06

    申请号:US10749299

    申请日:2003-12-31

    IPC分类号: G06F12/08

    摘要: System and method for performing operations in a multi-class file system without requiring split mirrors. For one or more storage classes in the multi-class file system, operations that require stable copies of the storage classes may be performed without using split mirrors. In one embodiment, read-only data may be assigned and/or migrated to lower storage classes, and operations may be performed on the read-only storage classes without using split mirrors. In one embodiment, to perform an operation without using a split mirror, a write lock of a storage class may be examined to determine if the write-locked storage class has been written to during the operation on the storage class and, if so, the operation may be retried for the storage class. In one embodiment, the file system software may be blocked from enabling a storage class for writing for the duration of the operation on the storage class.

    摘要翻译: 用于在多类文件系统中执行操作而不需要拆分镜像的系统和方法。 对于多类文件系统中的一个或多个存储类,需要稳定拷贝存储类的操作可以在不使用分割镜的情况下执行。 在一个实施例中,只读数据可以被分配和/或迁移到较低的存储类别,并且可以在只读存储器类上执行操作而不使用分离镜。 在一个实施例中,为了在不使用分割镜的情况下执行操作,可以检查存储类的写锁定以确定在存储类的操作期间是否写入了锁定存储类,并且如果是,则 可能会为存储类重试操作。 在一个实施例中,可以阻止文件系统软件在存储类的操作期间使存储类能够写入。

    Backup mechanism for a multi-class file system
    4.
    发明授权
    Backup mechanism for a multi-class file system 有权
    多类文件系统的备份机制

    公开(公告)号:US07103740B1

    公开(公告)日:2006-09-05

    申请号:US10749334

    申请日:2003-12-31

    IPC分类号: G06F12/00

    摘要: System and method for performing backups of a multi-class file system are described. In one embodiment, more recently modified data may be assigned and/or migrated to higher storage classes and less recently modified data may be migrated at time intervals to lower storage classes in the multi-class file system. Backups of each of the storage classes may be performed at time intervals. In one embodiment, the backups may be image-based backups of the storage devices in the storage classes. In one embodiment, the lower storage classes may include one or more read-only storage classes including less-recently modified data that are backed up less frequently than higher storage classes including more-recently modified data. In one embodiment, files migrated to lower storage class(es) may be compressed.

    摘要翻译: 描述用于执行多类文件系统的备份的系统和方法。 在一个实施例中,可以将更新的修改的数据分配和/或迁移到更高的存储类别,并且可以以较短的时间间隔将较少的最近修改的数据迁移到多类文件系统中的较低存储类别。 可以以时间间隔执行每个存储类的备份。 在一个实施例中,备份可以是存储类中的存储设备的基于映像的备份。 在一个实施例中,较低存储类别可以包括一个或多个只读存储类,包括最近修改的数据,其被备份的频率低于包括最近修改的数据的更高存储类别的频率。 在一个实施例中,迁移到较低存储类的文件可以被压缩。

    System and method for performing file lookups based on tags
    5.
    发明授权
    System and method for performing file lookups based on tags 有权
    基于标签执行文件查找的系统和方法

    公开(公告)号:US07228299B1

    公开(公告)日:2007-06-05

    申请号:US10428543

    申请日:2003-05-02

    IPC分类号: G06F17/30 G06F7/00

    摘要: A method for performing file lookups based on tags indicative of file characteristics may involve: a file system storing an association between a tag and a file, where the tag is indicative of a characteristic of the file; the file system storing an additional association between the tag and an additional file that also has the characteristic; the file system searching for files having the tag; and in response to searching, the file system returning identifiers of both files associated with the tag. The returned identifiers may include the files' pathnames or inode identifiers of the files' inodes.

    摘要翻译: 用于基于指示文件特征的标签执行文件查找的方法可以包括:文件系统,其存储标签和文件之间的关联,其中标签指示文件的特征; 所述文件系统存储所述标签与还具有所述特征的附加文件之间的附加关联; 文件系统搜索具有标签的文件; 并且响应于搜索,文件系统返回与标签相关联的两个文件的标识符。 返回的标识符可以包括文件的inode的文件路径名或inode标识符。

    Efficient storage and retrieval for large number of data objects
    6.
    发明授权
    Efficient storage and retrieval for large number of data objects 有权
    高效的存储和检索大量的数据对象

    公开(公告)号:US08650164B2

    公开(公告)日:2014-02-11

    申请号:US13491355

    申请日:2012-06-07

    IPC分类号: G06F17/30

    CPC分类号: G06F17/3028 G06F17/30091

    摘要: A data object management scheme for storing a large plurality of small data objects (e.g., image files) in small number of large object stack file for storage in secondary storage (e.g., hard disks). By storing many individual data objects in a single object stack file, the number of files stored in the secondary storage is reduced by several orders of magnitude, from the billions or millions to the hundreds or so. Index data for each object stack file is generated and stored in primary storage to allow efficient and prompt access to the data objects. Requests to store or retrieve the data objects are made using HTTP messages including file identifiers that identify the files storing the data objects and keys identifying the data objects. A file server stores or retrieves the data object from secondary storage of a file server without converting the requests to NSF or POSIX commands.

    摘要翻译: 一种数据对象管理方案,用于存储少量大对象堆栈文件中的大量多个小数据对象(例如,图像文件),用于存储在辅助存储器(例如,硬盘)中。 通过将多个单独的数据对象存储在单个对象堆栈文件中,存储在辅助存储器中的文件数量从数十亿或数百万减少到几个数量级。 生成每个对象堆栈文件的索引数据并将其存储在主存储中,以便有效和快速地访问数据对象。 存储或检索数据对象的请求使用HTTP消息进行,包括标识存储数据对象的文件和标识数据对象的键的文件标识符。 文件服务器从文件服务器的辅助存储器存储或检索数据对象,而不将请求转换为NSF或POSIX命令。

    Efficient storage and retrieval for large number of data objects
    7.
    发明授权
    Efficient storage and retrieval for large number of data objects 有权
    高效的存储和检索大量的数据对象

    公开(公告)号:US08219562B1

    公开(公告)日:2012-07-10

    申请号:US12620359

    申请日:2009-11-17

    IPC分类号: G06F17/30

    CPC分类号: G06F17/3028 G06F17/30091

    摘要: A data object management scheme for storing a large plurality of small data objects (e.g., image files) in small number of large object stack file for storage in secondary storage (e.g., hard disks). By storing many individual data objects in a single object stack file, the number of files stored in the secondary storage is reduced by several orders of magnitude, from the billions or millions to the hundreds or so. Index data for each object stack file is generated and stored in primary storage to allow efficient and prompt access to the data objects. Requests to store or retrieve the data objects are made using HTTP messages including file identifiers that identify the files storing the data objects and keys identifying the data objects. A file server stores or retrieves the data object from secondary storage of a file server without converting the requests to NSF or POSIX commands.

    摘要翻译: 一种数据对象管理方案,用于存储少量大对象堆栈文件中的大量多个小数据对象(例如,图像文件),用于存储在辅助存储器(例如,硬盘)中。 通过将多个单独的数据对象存储在单个对象堆栈文件中,存储在辅助存储器中的文件数量从数十亿或数百万减少到几个数量级。 生成每个对象堆栈文件的索引数据并将其存储在主存储中,以便有效和及时地访问数据对象。 存储或检索数据对象的请求使用HTTP消息进行,包括标识存储数据对象的文件和标识数据对象的键的文件标识符。 文件服务器从文件服务器的辅助存储器存储或检索数据对象,而不将请求转换为NSF或POSIX命令。

    EFFICIENT STORAGE AND RETRIEVAL FOR LARGE NUMBER OF DATA OBJECTS
    8.
    发明申请
    EFFICIENT STORAGE AND RETRIEVAL FOR LARGE NUMBER OF DATA OBJECTS 有权
    对大量数据对象的有效存储和检索

    公开(公告)号:US20120246129A1

    公开(公告)日:2012-09-27

    申请号:US13491355

    申请日:2012-06-07

    IPC分类号: G06F17/30

    CPC分类号: G06F17/3028 G06F17/30091

    摘要: A data object management scheme for storing a large plurality of small data objects (e.g., image files) in small number of large object stack file for storage in secondary storage (e.g., hard disks). By storing many individual data objects in a single object stack file, the number of files stored in the secondary storage is reduced by several orders of magnitude, from the billions or millions to the hundreds or so. Index data for each object stack file is generated and stored in primary storage to allow efficient and prompt access to the data objects. Requests to store or retrieve the data objects are made using HTTP messages including file identifiers that identify the files storing the data objects and keys identifying the data objects. A file server stores or retrieves the data object from secondary storage of a file server without converting the requests to NSF or POSIX commands.

    摘要翻译: 一种数据对象管理方案,用于存储少量大对象堆栈文件中的大量多个小数据对象(例如,图像文件),用于存储在辅助存储器(例如,硬盘)中。 通过将多个单独的数据对象存储在单个对象堆栈文件中,存储在辅助存储器中的文件数量从数十亿或数百万减少到几个数量级。 生成每个对象堆栈文件的索引数据并将其存储在主存储中,以便有效和及时地访问数据对象。 存储或检索数据对象的请求使用HTTP消息进行,包括标识存储数据对象的文件和标识数据对象的键的文件标识符。 文件服务器从文件服务器的辅助存储器存储或检索数据对象,而不将请求转换为NSF或POSIX命令。

    Time indexed file system
    9.
    发明授权
    Time indexed file system 有权
    时间索引文件系统

    公开(公告)号:US08060481B1

    公开(公告)日:2011-11-15

    申请号:US11439302

    申请日:2006-05-23

    IPC分类号: G06F7/00 G06F12/00 G06F17/00

    摘要: A method and mechanism for managing a time-indexed block map in a file system configured to store multiple versions of file data. A file system includes inodes or other structures corresponding to files in the system. Responsive to creating a file, one or more blocks are allocated for use in storing the file data. A block map is maintained for the file and is updated to include an identification of the blocks storing the file data and a timestamp corresponding to the stored data. In response to creating a file, data corresponding block map is maintained. In addition, a new entry is created in the block map which identifies the newly allocated blocks. Further, an entry of the block map is updated to (i) identify the particular blocks to which the write was directed and (ii) include a timestamp corresponding to the time of the write.

    摘要翻译: 一种用于管理被配置为存储文件数据的多个版本的文件系统中的时间索引块映射的方法和机制。 文件系统包括与系统中的文件相对应的inode或其他结构。 响应于创建文件,分配一个或多个块用于存储文件数据。 维持该文件的块映射并被更新为包括存储该文件数据的块的标识以及与存储的数据相对应的时间戳。 响应于创建文件,保持数据对应的块映射。 此外,在块映射中创建一个新条目,该条目标识新分配的块。 此外,块图的条目被更新为(i)识别写入所针对的特定块,并且(ii)包括与写入时间相对应的时间戳。

    Block-level and hash-based single-instance storage
    10.
    发明授权
    Block-level and hash-based single-instance storage 有权
    块级和基于散列的单实例存储

    公开(公告)号:US07454592B1

    公开(公告)日:2008-11-18

    申请号:US11355684

    申请日:2006-02-16

    IPC分类号: G06F12/00

    CPC分类号: G06F17/30097 G06F11/1453

    摘要: A method for reading data in a block-level single-instance storage system may involve receiving a first address of a data block, retrieving a signature corresponding to the first address, and reading data from a second address corresponding to the signature. A storage system may include a storage manager and first and second lookup tables. The storage manager may interface with an application (such as a database system or a file system) that uses a first set of identifiers for data blocks. The storage manager may use a second set of identifiers for the data blocks, and translates between the first and second identifiers using the lookup tables. The first lookup table indexes data block signatures according to the first set of identifiers. The second lookup table indexes the second set of identifiers according to the data block signatures. The second lookup table may be pruned to provide single instance storage.

    摘要翻译: 用于在块级单实例存储系统中读取数据的方法可以包括接收数据块的第一地址,检索对应于第一地址的签名,以及从对应于签名的第二地址读取数据。 存储系统可以包括存储管理器和第一和第二查找表。 存储管理器可以与使用数据块的第一组标识符的应用(例如数据库系统或文件系统)进行接口。 存储管理器可以使用数据块的第二组标识符,并且使用查找表在第一和第二标识符之间进行转换。 第一查找表根据第一组标识符来索引数据块签名。 第二查找表根据数据块签名索引第二组标识符。 可以修剪第二查找表以提供单个实例存储。